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The  purpose  of  this  study  was  to  examine  the  null  hypoth- 
esis that  there  were  no  differences  in  the  ratings  received 
by  tenured  and  nontenured  faculty  in  student  evaluations  of 
teaching  effectiveness.   This  study  further  sought  to  deter- 
mine if  there  were  student  evaluation  measures  which  were 
closely  associated  with  tenure  status  and  if  there  were  dif- 
ferences among  the  ratings  of  faculty  members  in  the  ranks 
of  professor,  associate  professor,  and  assistant  professor. 

Study  participants  were  268  professors,  associate  pro- 
fessors, assistant  professors,  and  instructors  in  the  Col- 
lege of  Arts  and  Sciences  at  the  University  of  Florida,  who 
had  been  evaluated  by  7,901  students  during  the  Winter 
Quarter  of  197^. 

Data  v/ere  obtained  through  a  study  of  publications  and 
a  study  of  records  v/hich  v/ere  on  file.   The  source  of  the 
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data  was  the  instrument  used  by  the  College  of  Arts  and 
Sciences  in  its  student  evaluations  of  faculty  members. 

The  unit  of  analysis  v/as  the  item  mean  for  each  fac- 
ulty member.   Teaching  effectiveness  v;as  measured  on  the 
basis  of  the  mean  rating  received  by  a  faculty  member  on 
each  of  the  10  items  on  the  student  evaluation  form. 

A  multivariate  one-vray  analysis  of  variance  was  per- 
formed to  test  for  differences  among  six  groups  identified 
by  both  their  tenure  status  and  professorial  rank:   tenured 
professors,  tenured  associate  professors,  tenured  assistant 
professors,  nonteniored  associate  professors,  nontenured  assis- 
tant professors,  and  nontenured  instructors.   Simultaneous 
confidence  intervals  were  established  for  the  rating  means. 
Data  from  all  10  items  on  the  evaluation  instrument  v/ere 
used  to  determine  whether  a  discriminant  analysis  would  make 
a  distinction  between  tenured  and  nontenured  faculty.  Means 
were  calculated  for  the  ratings  of  tenured  and  nontenured 

faculty  and  for  professors,  associate  professors,  and  assis- 

2 
tant  professors.   Hotelling's  T  test  was  used  to  test  for 

differences  between  the  ratings  of  (a)  tenured  and  nontenured 
faculty,  (b)  professors  and  associate  professors,  and  (c)  asso- 
ciate professors  and  assistant  professors. 

The  results  of  this  investigation  indicated  that: 

1.  Student  ratings  of  teaching  effectiveness  for  ten- 
ured and  nontenured  faculty  were  significantly  dif- 
ferent at  the  .05  alpha  level. 
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2.  Student  ratings  of  teaching  effectiveness  for  pro- 
fessors and  associate  professors  and  for  associate 
professors  and  assistant  professors  v;erc  different 
at  the  .05  level  of  significance. 

3.  Nontenured  faculty  members  received  better  ratings 
than  tenured  faculty  members;  associate  professors 
received  better  ratings  than  professors;  and  asso- 
ciate professors  received  slightly  better  ratings 
than,  assistant  professors. 

4-.  The  discriminant  analysis  made  a  distinction  between 
tenured  and  nontenured  faculty  by  reclassifying  as 
tenured  all  except  one  tenured  faculty  member  and  by 
reclassifying  as  nontenured  all  except  one  nonten- 
ured faculty  member. 

5.  No  definite  patterns  of  difference  on  evaluation 
items  by  tenured  and  nontenured  faculty  were  shown. 

Based  on  the  findings  of  this  investigation,  attention 
and  further  study  should  be  given  to  four  relevant  concerns: 
(a)  the  teaching  effectiveness  of  faculty  members  prior  to 
and  following  the  granting  of  tenure;  (b)  the  granting  of 
tenure  for  a  specified  period,  with  independent  evaluations 
for  tenure  at  the  end   of  each  set  time  period;  (c)  the  weight 
attached  to  teaching  effectiveness  in  tenure  considerations; 
and  (d)  the  role  of  student  evaluation  of  teaching  effec- 
tiveness in  tenure  considerations. 


CHAPTER  I 
E^'TRODUCTION 

The  decade  of  the  sixties  sav7  tremendous  concern  over 
the  use  of  student  evaluations  as  a  measure  of  teaching  per- 
formance in  universities  and  colleges  thi'oughout  the  United 
States.   This  concern  was  followed — during  the  late  sixties 
and  early  seventies — hy  a  reemergence  of  the  questioning  of 
the  concept  of  tenure.   Logical  questions  have  historically 
been  raised  and  can,  therefore,  he  raised  regarding  the 
relationship  between  a  facu].ty  member's  tenure  status  and 
his  performance  in  his  position,  particularly  as  it  may 
relate  to  teaching.   It  was  to  these  kinds  of  concerns  that 
this  inquiry  was  addressed. 

Largely  because  of  the  financial  exigency  which  plagued 
many  public  institutions  of  higher  education  during  the 
1973-7'4-  school  year,  greater  attention  is  being  focused 
upon  tenure.   Faculty  members  who  have  not  yet  acquired 
tenure. a.re  concerned  about  their  loss  of  ^obs  and  the 
inability  to  move  up  in  the  professorial  ranks.   Faculty 
members  who  do  have  tenure  are  appalled  over  the  actual 
inexistence  of  job  security  and  are  demanding  that  tenure 
laws  be  revised.   In  a  197'^-  article  concerning  the  dismissal. 


en  masse,  of  tenured  faculty,  Semas  stated: 

The  University  of  Wisconsin  sent  layoff  notices 
last  May  to  88  tenured  faculty  members  on  nine 
of  its  campuses,  all  of  ttiem  formerly  part  of 
the  Wisconsin  Sta-ce  University  system.  1 

'Traditionally  teniore  has  provided  a  fairly  unquestion- 
able security  for  faculty  members.   It  has  shielded  many 
persons  from  the  whimsical  designs  of  their  superiors,  has 
provided  the  protection  that  faculty  members  needed  as  they 
embarked  upon  unorthodox  methods  and  championed  unpopular 
ideas,  and  has  guaranteed  persons'  having  jobs  from  year  to 
year. 

Today,  hov/ever,  many  people  are  questioning  the  value 
of  tenure,  particularly  in  view  of  the  recent  firings  of 
large  niombers  of  tenured  faculty  members.   Some  persons 
believe  that  tenure  should  be  abolished,  but  others  still 
support  tenure  wholeheartedly.   Some  persons  believe  that 
tenure  laws  are  inadequate  but  that  they  should  not  be 
abolished  because  they  do  provide  a  measure  of  protection. 
In  an  unprecedented  decision,  on  the  othei"  hand,  the 
Virginia  State  Board  for  Community  Colleges  decided  to  no 
longer"  grant  tenui'e  at  its  22  institutions.   As  reported 
in  Intellect ,  this  move  was  believed  to  be  the  first  of  its 


'Philip  \'I.    Semas,  "Faculty  Firings  Soar  as  Slump  Hits 
Enrollment,"  The  Chronicle  of  Higher  Education,  28  January 

1974,  p.  1. 


2 
kind  in  the  country.    Tlras,  tenure  has  created  a  major 

debate  among  educators. 

At  least  three  of  the  issues  surrounding  tenure  have 
developed  since  the  beginning  of  197? — a  factor  which  gives 
evidence  of  the  ever-grov/ing  complexity  of  tenure:   (a)  ten- 
ure as  a  part  of  the  collective  bargaining  process,  (b)  the 
role  of  nontenured  teachers  in  institutional  government,  and 
(c)  the  tenure  component  of  women  and  minority  group  members. 
Other  issues,  which  were  practically  dormant,  have  come 
alive  with  unparalleled  impetus:   (a)  tenure  as  it  relates 
to  the  allocation  of  institutional  finances,  (b)  financial 
exigency  and  its  concomitant  job  insecurity,  (c)  tenure 
quotas,  (d)  tenui^e  and  the  demand  for  greater  accountability, 
(e)  due  process  in  terminating  nontenured  faculty  members, 
and  (f )  the  allocation  of  decisional  power  between  trustees 
and  faculty  in  the  termination  process.   But  despite  the 
problems  and  controversies  surrounding  it,  the  practice  of 
granting  tenure  remains  rather  stable. 

Although  teaching  effectiveness  as  determined  by  admin- 
istrative superiors  has  been  used  for  many  years  as  a  cri- 
tei'ion  for  granting  tenure  at  the  University  of  Florida, 
teaching  effectiveness  as  measured  by  students  has  only 
been  given  such  consideration  since  1972.   The  focus  of  this 




"Elimination  of  Faculty  Tenure,"  Intellect  101  (March 
1973): 3^6. 
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study  V7as,  therefore,  upon  student  evaluations  and  tlie  ten- 
ure Suauus  Oi  lacuj-uy  11151111)6x3  at  tne  University  oi'  Florida. 

The  Problejn 

Statement  of  the  Problem 

The  problem  of  this  study  was  to  examine  the  null 
hypothesis  that  there  v/ere  no  differences  in  the  ratings 
received  by  tenured  and  nontenured  faculty  in  student  eval- 
uations conducted  in  the  College  of  Arts  and  Sciences  at 
the  University  of  Florida.   In  this  examination  attention 
was  given  to  the  questions  listed  below: 

1.  Were  there  student  evaluation  measiires  that  were 
closely  associated  ;vith  tenure  status? 

2.  Were  there  significant  differences  among  the  ratings 
of  faculty  members  in  the  academic  ranks  of  profes- 
sor, associate  professor,  and  assistant  professor? 

Delimitations  and  Limitations 

In  conducting  the  research  the  investigator  observed 
the  following  delimitations  and  limitations: 

1.  The  study  was  confined  to  the  College  of  Arts  and 
Sciences  at  the  University  of  Florida. 

2.  Only  the 3  6  faculty  members  v/ho  v/ere  evaluated  during 
the  Wi-iter  Quarter  of  13'7^   v/ere  used  in  the  study. 

5.  Data  were  obtained  through  a  study  of  records  and 
pub 1 ic  at  i  oas . 


Justification  for  the  Study 

One  of  the  avowed  purposes  of  tenure  is  to  guarantee 
the  student  of  having  a  competent,  effective  teacher;  but 
there  is  no  empirical  evidence  to  support  the  general  belief 
that  tenured  faculty  members  are  more  effective  teachers 
than  nontenured  faculty  members.   Because  of  the  lack  of 
research  on  tenure  and  teaching  effectiveness  as  measured 
l)j   student  evaluations ,  this  study  will  serve  as  an  addi- 
tion to  the  body  of  existing  knowledge  on  tenure  and  as 
a  reference  for  administrators  and  faculty  in  tenure  con- 
siderations. 

Assumptions 
The  basic  assumptions  in  this  investigation  Vv'ere  that 
the  results  obtained  through  student  evaluations  were  accu- 
rate and  that  the  instrument  used  to  measure  teaching  effec- 
tiveness i\ras  valid  and  reliable. 

Definition  of  Terms 
Academic  rank. — The  University's  official  designation 
of  a  faculty  member  as  professor,  associate  professor, 
assistant  professor,  or  instructor. 

Evaluation. — The  consideration  of  evidence  regarding 
teaching  in  the  light  of  the  value  standards,  the  particular 
situation,  and  the  goals  of  the  student. 

Evaluation  instrument. — The  instrument  used  by  the 
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College  of  Arts  and  Sciences  in  its  student  evaluation  of 
faculty  members. 

Faculty. — Professors,  associate  professors,  assistant 
professors,  and  instructors  in  the  departments  of  the  Col- 
lege of  Arts  and  Sciences. 

Professorial  raiik:. — A  faculty  member's  classification 
as  professor,  associate  professor,  assistant  professor,  or 
instructor. 

Teaching  effectiveness. — The  rating  which  students 
gave  a  faculty  member  on  the  evaluation  instrument. 

Tenure. — Permanent  faculty  membership. 

Tenured  faculty. — Faculty  members  who  had  been  granted 
tenure  prior  to  the  Winter  Quarter  of  197'^- 

Tenure  status. — The  classification  of  a  faculty  member 
as  tenured  or  nont enured. 

Procedures 

Study  Participants 

The  subjects  who  v;ere  selected  for  this  study  were  the 
268  University  of  Florida  College  of  Arts  and  Sciences  pro- 
fessors, associate  professors,  assistant  professors,  and 
instructoi^s  who  were  evaluated  by  7:901  students  during  the 
Winter  Quarter  of  197'^ • 


Sources  of  Data 

xiie  sources  of  data  were  the  instruuient  which  was  used 
by  the  College  of  Arts  and  Sciences  in  its  student  evalua- 
tion of  faculty  members  and  records  which  were  on  file  in 
the  Office  of  Academic  Affairs.   The  instrument  used  for 
student  evaluations  in  the  College  of  Arts  and  Sciences  is 
presented  below: 

EVALUATION  FORM 
QUESTIONS:  ' 

1.  The  instructor  was  enthusiastic  when  presenting  course 
material. 

2.  The  instructor  seemed  to  be  concerned  with  whether  the 
students  learned  the  material. 

3.  lou  felt  that  this  course  challenged  you  intellectually. 

4.  The  instructor  appeared  receptive  to  new  ideas  and  others' 
vie^vpoints. 

5.  The  instructor  generally  stimulated  class  discussion. 

6.  The  instructor  attempted  to  cover  too  much  material. 

7.  The  homework  assignments  were  too  time  consujning  relative 
to  their  contribution  to  your  understanding  of  the  course 
material. 

8.  The  instructor's  presentations  made  for  easy  note-taking. 
9-  The  direction  of  the  course  was  adequately  outlined. 

10.  You  generally  enjoyed  going  to  class. 

RATINGS : 

1.  if  you  strongly  agree  with  the  statement 

2.  if  you  agree  with  the  statement 

3.  if  you  neither  agree  nor  disagree  with  the  statement 
^V.  if  you  disagree  with  the  statement 

5-  if  you  strongly  disagree  with  the  statement 


.  s 

Data  Collection 

Data  were  collected  tlirough  the  steps  listed  below: 

1.  The  researcher  obtained  from  the  registrar's 
office  a  copy  of  the  "Course  and  Teacher  Evalua- 
tion" for  the  Winter  Quarter  of  197^4-,  v/hich  was 
prepared  and  published  jointly  by  the  University, 
of  Florida  Senate  and  Omicron  Delta  Kappa. 

2.  From  records  on  file  in  the  Office  of  Academic 
Affairs,  the  researcher  ascertained  the  tenure 
status  and  academic  rank  of  each  faculty  member 
included  in  the  V/inter,  197"^,  student  evaluation  of 
faculty  members  in  the  College  of  Arts  and  Sciences. 

Data  Treatment 

1.  Ratings  were  averaged  for  each  faculty  member  who 
had  been  evaluated  by  more  than  one  class. 

2.  A  multivariate  test  of  hypothesis  v;as  performed 

to  determine  whether  there  v/ere  differences  in  the 
mean  vectors  for  groups  that  were  identified  by 
both  their  tenure  status  and  professorial  rank. 

3.  Because  it  was  concluded  that  the  mean  vectors 
were  different,  simultaneous  confidence  intervals 
were  constructed  for  the  rating  means  of  the  groups. 

^■.    Data  from  the  10  items  on  the  evaluation  instrujnent 
v;ere  used  to  find  out  whether  a  discriminant  analy- 
sis v/ould  make  a  distinction  between  tenured  and 
nontenured  faculty. 


5-  The  mean  was  calculated  for  the  ratings  of  ten- 
ured and  nontenured  faculty  and  for  professors, 
associate  professors,  and  assistant  professors  on 

each,  of  the  10  evaluation  items. 

2 
6.  Kotelling's  T  test  was  used  to  test  for  differ- 
ences "between  the  ratings  for  tenured  and  nonten- 
ured faculty  members;  professors  and  associate 
professors;  and  associate  professors  and  assis- 
tant professors. 

Organization  of  the  Study 
This  thesis  is  presented  in  six  chapters.   Chapter  I 
presents  the  problem  of  the  investigation  in  perspective. 
Chapter  II  gives  a  chronological  discussion  of  the  prac- 
tice of  granting  tenure  and  outlines  the  requirements  for 
receiving  tenure  at  the  University  of  Florida.   Chapter  III 
is  devoted  to  a  reviev;  of  related  literature  and  research. 
The  date,  are  presented  in  Chapter  IV.   Chapter  V  contains 
the  analysis  and  discussion  of  the  data.   And  Chapter  VI 
presents  the  findings  and  conclusions  of  the  investigation 
and  recommendations  for  further  study. 


CHAPTER  II 

BACKGROUiro  OF  THE  PROBLEM 

Tile  revival  of  ijaterest  in  tenure  during  the  1970s 
implied  that  the  concept  of  tenure  was  one  of  a  short  dura- 
tion.  But  the  current  surge  of  interest  in  tenure  is  not 
an  indicator  of  its  span  of  existence;  for  tenure  dates  back 
to  the  Middle  Ages,  x-;hen  it  served  as  a  fortification  against 
external  dangers.   In  his  description  of  tenure  during  the 
Middle  Ages,  Metzger  stated: 

Tenure  in  magisterial  universities  was  not  an  at- 
tribute of  occupancy  of  office,  with  set  emolu- 
ments and  prescribed  f^onctions,  but  an  attribute 
of  admission  to  a  corpus,  possessed  of  a  legal 
personality  and  (in  part  through  delegation,  in 
part  through  usurpation)  of  considerable  govern- 
mental power,  of  a  kind  of  minisovereignty.   Ad- 
mission to  this  body  was  accomplished  not  through 
the  contract  of  employment  but  through  the  cross- 
ing of  certain  qualificatory  thresholds — the  earn- 
ing of  degrees,  the  exliibition  of  certain  prowesses, 
the  acquisition  of  a  license — over  which  the  masters 
took  command. 1 

To  continue  as  a  member  of  the  corpus  one  was  not  required 

to  perform  specific  duties  (an  individual  could  remain  a 

master  in  good  steaiding  even  if  he  did  not  teach);  instead, 

he  only  had  to  adhere  to  collegial  comities.   Ajid  one  could 


V/alter  P.  Metzger,  "Academic  Tenure  in  America:  A  His- 
torical Essay,"  in  Faculty  Tenure,  ed.  ¥.  R.  Keast  (San  Fran- 
cisco: Jossey-Bass,  1973_)  ,  p.  101. 
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2 
not  be  expelled  except  by  members  of  the  body  itself.   Metz- 

ger  regarded  this  period  as  "Tenure  as  Privilege:  The  Era  of 

the  Master."   He  further  delineated  two  succeeding  periods, 

which  he  referred  to  as  "Tenujre  as  Time:  The  Age  of  the 

Employee"  ar^d  "Tenure  as  Judiciality:  The  Age  of  the  Pro- 

fessional." 

Tenure  as  it  is  knovm  in  the  mid-1970s  is  an.  outgrov/th 

of  the  second  period:  The  Age  of  the  Employee,  with  Harvard 

College  in  the  fore  and  William  and  Mary,  Yale,  and  Princeton 

following.   It  should  be  noted,  hov:ever,  that  even  during 

this  period  tenure  was  in  an  evolutionary  process  for  two 

centuries.   Among  the  many  changes  i\rhich  occurred  at  this 

time,  two  are  of  utmost  significance — as  forerunners  of  the 

present  system  of  tenure.   The  first  change  established  a 

limit  for  the  number  of  years  that  one  could  remain  in  a 

professorial  rank: 

'In  1860,  it  Cthe  corporatiorj  limited  not  only  the 
time  of  each  tutorial  appointment  but  the  time  each 
teacher  could  spend  v/ithin  that  rank,  the  maximum 
number  of  years  being  set  at  eight.' 5 

A  second  major  transpiration  was  the  Murdock  case,  which 

challenged  the  criteria  for  termination.   Although  the  Supreme 


2 
Metzger,  "Academic  Tenure,"  p.  101. 

%bid.,  p.  9^. 

^Ibid. ,  pp.  Ill,  135. 

^Ibid. ,  p.  119. 
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Judicial  Court  of  liassachusetts  deferred  to  tlie  findings  of 

the  governing  board  uJider  trie  main  charge  of  neglect  of  duty, 

in  Murdock,  the  Court  held  that  three  other  charges  did  not 

justify  dismissal  of  the  professor.    Thus,  the  v/ay  was 

paved  for  future  challenges  of  the  substantive  criteria  for 

termination. 

The  third  period,  The  Age  of  the  Professional,  was  sig- 
naled by  the  formation  of  the  American  Association  of  Uni- 
versity Professors  (AAUP) .   In  1915,  18  professors  at  Johns 
Hopkins  University  signed  a  letter  and  sent  it  to  their  col- 
leagues at  nine  other  major  institutions,  urging  them  to 
join  in  forming  a  national  professors'  association.   Six 
hundred  select  persons  accepted  the  invitation  to  become 
charter  members,  and  in  January,  1913,  the  AAUP  was  formed.' 

Quoting  from  the  Loyb^oj   Papers  (Lovejoy  was  the  framer 

of  the  Johns  Hopkins  letter) ,  Metzger  stated: 

The  Johns  Hopkins  call  proposed  that  the  new  pro-  ■ 
fessional  body  undertake  'the  gradual  formulation 
of  principles  respecting  the  tenure  of  profes- 
sional office  and  the  legitimate  ground  for  the 
dismissal  of  professors'  and  that  it  establish  'a 
representative  judicial  committee  to  investigate 
and  report  in  cases  in  xi/hich  freedom  is  alleged 
to  have  been  interfered  with  by  administrative 
authorities  of  any  university  or  in  which  serious 


6 
James  Murdock,  Appellant  from  a  Decree  of  the  Visitors 

of  the  Theological  Institution  of  Phillips  Academy,  in  An- 

dover,  7  Pick.  305  (1828). 
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and  linviarranted  injury  to  the  professional  stan- 
ding and  opportunities  of  any  professor  is  de- 
clared to  have  occurred. '° 

For  a  long  time  professors  had  been  concerned  about  their 
security  through  tenure  and — especially  since  the  contro- 
versy over  evolution,  in  the  1870s — they  had  soughb  aca- 
demic freedom.   But  what  was  now  so  astonishingly  signifi- 
cant was  the  uniting  of  these  two  concerns  in  one  profes- 

9 
sional  plan  of  action. ^ 

General  Guidelines  for  Tenure-Granting 
Institutions 

/  The  basic  criteria  for  granting  tenure  in  postsecondary 
institutions  were  established  by  the  American  Association  of 
University  Professors  and  the  Association  of  American  Col- 
leges (AAC)  in  their  "19'4-0  Statement  of  Principles"  (which 
supersedes  all  of  the  preceding  Statements)  and  have  been 
endorsed  by  all  of  the  major  higher  education  organizations 
in  the  United  States. 

The  general  stipulations  of  the  19-^0  Statement  are  that 
(a)  institutions  provide  tenure,  (b)  the  exact  terms  under 
v/hich  a  person  is  being  hired  be  stated  in  v/riting,  (c)  the 
probationary  period  for  teachers  not  exceed  seven  years, 
(d)  all  teachers  have  academic  freedom,  (e)  in  cases  of  fac- 
tual disputes  all  teachers  be  granted  hearings,  and  (f)  that 


'Metzger,  ''Academic  Tenure, "  p.  135, 
^Ibid. 
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the  termination  of  tenured  faculty  raembers  because  of  finan- 
cial exip'enc'v  be  bona  fide.   The  criteria.,  as  presented  by 
the  AAUP  and  AAC,  do  not  prescribe  precise  rules  to  be  fol- 
lowed; hence,  each  institution,  while  adhering  to  the  19^0 
Statement,  has  a  rather  broad  latitudinal  range  for  opera- 
tion. 

Criteria  for  Determining  Teniire  Status        •  . 
at  the  University  of  Florida 

/  Subscribing  to  the  general  evaluative  criteria  estab- 
i 

lished  in  the  "1940  Statement  of  Principles,"  the  University 

of  Florida  has  provided  in  its  Constitution  specific  criteria 

for  the  granting  of  tenure,  foi'  example: 

Eligibility  for  tenure  for  faculty  members  in 
the  ranks  of  professor,  associate  professor,  and 
assistant  professor,  or  in  equivalent  ranks, 
shall  begin  after  five  years  of  service  in  a 
tenure-earning  position  .  .  .  .^^ 

As  stated  in  the  Constitution,  nomination  of  a  faculty  mem- 
ber for  tenure  is  an  indication  that  one  is  and  will  be  an 
asset  to  the  University: 

Nomination  of  a  faculty  member  for  teniire  shall 
signify  that  a  high  degree  of  competence  has 
been  demonstrated  and  continuing  employment  of 
the  faculty  member  will  serve  the  best  inter- 
ests of  the  institution  and  the  University  Sys- 
tem. H 


"Constitution  of  the  University  of  Florida"  (as 
amended  through  March,  1972),  art.  3i    sec.  5» 


Ibid. 
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The  t enure -gratiting  process  at  the  University  of 

Florida  requires  that  a  faculty  member  be  (a)  recom- 
mended for  tenure  by  the  appropriate  department  chair- 
man or  unit  officer,  (b)  nominated  by  the  President, 
(c)  reviewed  by  the  Chancellor  of  the  State  University 
System,  and  (d)  approved  by  the  Board  of  Regents.   Eeceiving 
tenure  at  the  University  of  Florida  is  a  major  achievement 
for  a  faculty  member,  for  it  means  that  he  has  earned  per- 
manent faculty  membership  and  vjill  be  employed  continuously 
by  the  University  until,  as  stated  in  the  Constitution,  he 
(a)  voluntarily  leaves  the  institution  or  retires,  (b)  reaches 
the  mandatory  retirement  age,  (c)  is  dismissed  for  justifi- 
able cause  (as  described  in  the  Constitution),  (d)  is 
no  longer  needed  because  his  position  is  discontinued  or  the 

activities  in  which  he  is  engaged  are  terminated,  or  (e)  he 

,.    12  ■■ 
dxes. 

While  adhering  to  the  general  criteria,  as  stipulated 
by  the  AAUT  and  AAC ,  the  University  of  Florida  has,  never- 
theless, exercised  its  prerogative  to  utilize  student  eval- 
uation as  an  aid  in  determining  the  tenure  status  of  its 
faculty.   Article  V,  Section  5?  of  the  "Constitution  of  the 
University  of  Florida"  provides  that: 

At  the  time  a  faculty  member  becomes  eligible  for 
tenure,  the  appropriate  department  chairman  or  of- 


"Constj.tution, "  art.  5,  sec.  5- 
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ficer  in  charge  of  the  unit  concerned,  after  con- 
sultation with  the  tenured  members  of  the  depart- 
.  ment  or  unit,  and  after  taking  into  account  other  . 
considerations  such  as  student  evaluations  j_n  the 
case  of  instructional  positions,  shall  nominate 
him  for  that  status  ...  or  shall  postpone  such 
nomination  and,  in  either  case,  shall  inform  him 
in  writing.  15 

Not  only  is  the  use  of  student  evaluation  in  the  tenure- 
determining  process  mentioned  in  publications  designed  " 
e:>cpressly  for  faculty  members,  but  also  in  publications 
prepared  primarily  for  students.   In  the  1972-75  Course 
and  Teacher  Evaluation  Handbook,  students  v;ere  urged  to 
take  care  in  completing  future  teacher  evaluation  forms  for 
two  reasons.   One  of  the  reasons  v/as  "the  fact  that  begin- 
ning this  year  [1972-75]  the  evaluations  are  being  used  by 

administrators  as  an  'input  in  decisions  affecting  salary, 

14 
tenure,  and  promotions.'"    A  similar  statement  concerning 

the  use  of  student  evaluations  was  included  in  the  1973-7'^ 
Course  and  Teacher  Evaluation  Handbook:  the  "information 
is  used  by  the  administration  to  affect  salary,  promotion, 
and  tenure  .  .  .  . "  -^ 

Initiated  at  the  height  of  the  nationv:ide  tenure  con- 
troversy, the  use  of  student  evaluations  in  tenure  con- 


15 
-'^"Constitution,"  art.  5?  sec.  5- 
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siderations  at  the  University  of  Florida  may  be  viewed  as 

a  response  to  tlie  problems  created  by  tenure.   For  the  con- 
troversies surrounding  tenure  have  generated  institutional 
and  organizational  concern  and  study  throughout  the  United 
States.   Indeed,  in  a  1973  study  on  tenure,  Freeman  and 
Eossmeier  reported: 

In  recent  months  almost  every  periodical  on  high- 
er education  has  devoted  at  least  one  article  to 
the  subject  of  tenure.   The  Kew  York  Times,  the 
V/all  Street  Journal,  and  countless  lesser  knovm 
newspapers  are  also  carrying  articles  about  the 
debate.   There  is  also  the  proliferation  of  such 
books  as  The  Tenure  Debate,  Tenure,  Aspects  of 
Job  Security  on  the  Changing  Campus,  and  Tenure 
in  American  Higher  Education  ....   On  the 
national  scale  the  Commission  on  Academic  Tenure 
in  Higher  Education,  sponsored  by  the  AAUP  and 
the  Association  of  American  Colleges,  has  just 
concluded  a  tv/o-year  study.  16 

But  despite  the  proliferative  writing  and  research  on 
tenure,  no  all-encompassing  solutions  to  the  issues  sur- 
rounding tenure  have  been  discovered.   Even  the  two-year 
study  by  the  Commission  on  Academic  Tenure  has  not  provided 
satisfactory  answers.   In  a  survey  of  200  nontenured  assis- 
tant professors,  Budig  and  Decker  reported  that  the  respon- 
dents found  little  solace  in  The  Tenure  Debate  or  in  the 
report  of  the  Commission  on  Academic  Tenure.  ' 
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Thus,  with  no  precedents  set  or  no  generalizahle  con- 
clusions formed,  it  has  become  necessary  for  each  institu- 
tion to  search  for  its  ovrn  solutions  to  problems  created  by 
tenure.   It  is  in  this  vein  that  this  comparison  of  the  stu- 
dent ratings  of  tenured  and  nontenured  faculty  at  the  Uni- 
versity of  Florida  is  made. 


,  CHAPTER  III 

REVIEW  OB'  EEIATED  LITERATURE  MJ)   RESEARCH 

This  review  is  devoted  to  literature  and  research,  on 
tenure,  teaching  effectiveness,  and  student  evaluations — 
with  emphasis  upon  the  interrelationships  between  and  among 
these  areas.   The  three  major  subdivisions  of  the  review  are 
entitled  "Tenure,"  "Teaching  Effectiveness, "  and  "Student 
Evaluations."  ■     ,.  ' 


Tenure 


The  involvement  of  students  in  the  teacher  evaluation 
process  is  a  response  to  tenure  controversies,  which  have 
been  intensified  by  financial  exigencies  ap.d  the  demand  for 
greater  accountability.   According  to  Tolor,  efforts  to 
appraise  teacher  competence  have  assumed  increasing  urgency 
because  of  three  major  developments:  (a)  "the  grov/ing  accep- 
tance of  the  principle  of  accountability,"  (b)  "the  changing 
economic  picture  in  which  a  combination  of  recessionary 
trends  and  inflationary  pressures  have  produced  a  diminished 
tolerance  on  the  part  of  most  people  for  assioming  heavy 
tax  burdens,"  and  (c)  "the  mounting  concern  with  the  issue 
of  the  relevance  of  the  educational  enterprise  in  a  rapidly 


"1  o 


20 

changing  society  lihere  traditional  values  and  goals  are 
constantly  cliallenged. '' 

A  crucial  factor  concerning  institutional  financial 
need,  however,  is  the  stipiilation  in  the  "19'^0  Statement 
of  Principles"  that  tenured  faculty  be  released  only  in 
cases  of  "bona  fide  financial  exigency.   Thus,  v/henever  an 
institution  is  faced  v>rith  financial  prohlems,  nontenured 
faculty  members  are  the  first  to  be  released.   And  without 
evidence  to  support  such  action,  no  conclusions  can  be  drawn 
about  the  teaching  effectiveness  of  tenured  versus  nonten- 
ured faculty — that  is,  it  may  be  true  that  the  stipulation 
above  protects  competent  faculty  members.   On  the  other 
hand,  one  might  find  that  the  stipul^ation  a.bove  shelters 
incompetent  faculty  members  at  the  expense  of  more  competent 
ones. 

The  results  of  a  study  conducted  by  Bauer  shox^fed  that 

faculty  members  viewed  the  tenure  system  as  one  that  could 

2 
lead  to  the  protection  of  incompetence.    The  purpose  of 

Bauer's  study  was  to  compare  the  tenure  process  and  faculty 
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attitudes  toward  it  at  one  campus  of  the  University  of  Cali- 
fornia and  one  campus  of  the  California  State  University 
System.   Twenty  faculty  members  from  each  campus  were  inter- 
viewed the  year  immediately  after  they  received  tenure.   The 
key  question  posed  to  the  interviev/ees  concerned  what  each 
person  felt  was  the  most  apparent  xveakness  of  the  tenure 
appointment  system  at  that  time.   The  ■'jnanimous  response 
was  "the  tenure  system  can  be  subject  to  abuse  rather  easily 
and  it  can  lead  to  undesirable  protection  of  incompetence  or 
foster  mediocrity.' 

Discussing  the  tenure  problem  in  a  similar  vein,  Hughes 
stated,  "What  began  as  a  system  to  protect  professional  civil 
liberties  has  become  instead  a  reward  for  the  few  and  a  curse 
to  the  many."   Fiirther,  in  relating  the  United  States'  eco- 
nomic crisis  to  tenure,  Hughes  gave  the  following  descrip- 
tion: 

Sv.rollen  populations  in  some  areas  with  too  few 
instructors,  shrunken  populations  in  other  areas 
with  a  surplus  of  instructors — and  an  economy 
and  a  tenure  system  that  preclude  hiring  and 
firing  where  needed. 5 
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The  Tenure  Debate 

Indeed,  the  nation's  economic  plight — with  its  con- 
comitant effects  upon  higher  education — has  led  to  a  ma^or 
debate  among  the  proponents  and  the  opponents  of  tenure. 
In  examining  the  issues  of  the  tenure  debate,  Shulm.an 
pointed  out  that  "critics  of  the  tenure  system  do  not 
dispute  the  need  for  academic  freedom,  but  they  contend 
that  the  two  can  be  separated  and  that  academic  freedom 
can  be  protected  by  other  means. "^ 

■  In  addition,  Mann  reported  that  the  results  of  a  sur- 
vey of  American  Association  for  Higher  Education  (AAHE)  mem- 
bers shovred  that  64-%  of  I56O  respondents  felt  that  the  tenure 
system  needed  major  modifications,  v/hile  only  15%  felt  that 
the  tenure  system  was  basically  sound  and  21%  felt  that  it 
should  be  completely  abandoned.'^  Another  sui^vey,  by  Budig 
and  Decker,  showed  that  200  nontenured  assistant  professors 
at  10  major  public  universities  (mainly  Big  Ten  schools) 
felt  that  tenure  in  no  way  protected  their  academic  freedom. 
But  193  of  them  believed  that  tenure  did  protect  the  freedom 
of  tenured  professors.   Two-thirds  of  the  respondents,  feel- 
ing more  threatened  from  within  academia  than  without,  ex- 
pressed concern  about  being  at  the  mercy  of  their  tenured 
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colleagues — that  is,  that  tenured  faculty  members  would 
determine  their  tenure  fate. 

Further  attestation  to  the  tenure  debate  is  the  change 
in  tenure  policies  from  1972  to  197^.   A  typical  example  is 
the  change  that  has  been  effected  in  regard  to  the  maximum 
length  of  the  probationary  period  for  tenure,  as  indicated 
through  surveys.   S-orveys  conducted  by  El-Khav;as  and  Fiirniss 
shov;ed  that  in  1972,  among  public  and  private  4-  and  2-year 
colleges,  only  0.^+%  of  private  4-year  colleges  had  as  a  maxi- 
mum-length probationary  period  for  tenure  "9  or  more  years." 
In  1974,  however,  1.7%  of  private  colleges  and  7.2%  of   pri- 
vate \iniversities  had  a  maz-iimum  probationary  period  of  "9 
or  more  years."  Another  significant  finding  was  that  in 
response  to  the  question  of  v/hether  full-time  faculty  could 
be  granted  tenure  at  an  institution  the  percentages  of  the 
colleges  which  responded  "yes"  decreased  from  1972  to  1974: 
in  private  4-year  colleges  the  decrease  was  from  94.1%  to 
93.2%;  in  public  2-year  colleges  from  68.3%  to  66.9%;  and 
in  private  2-year  colleges  from  68.3^  to  65.7%.'^ 
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Tenure  and  AccQ-untability 

Despite  the  fact  that  public  institutions  are  limited 
by  law  in  what  they  can  do  to  modify  tenure  systems,  the 
public  is  demanding  more  returns  for  dollars  invested  in 
education.   This  demand  for  accountability  has  created 
greater  interest  in  tenure.   "Since  196?,"  Lieberman  stated, 
"13  states  have  enacted  legislation  dealing  with  personnel 
evaluation,  and  such  legislation  has  been  introduced  but  not 
enacted  in  at  least  seven  other  states.""'"'^ 

Yet,  while  citizens  are  asking  for  evidence  shov/ing 
that  they  are  getting  V7hat  they  are  paying  for,  faculty 
members  are  holding  on  tightly  to  the  jobs  that  they  have. 
A  few  years  ago — during  more  prosperous  times — teachers 
were  not  overly  concerned  about  dismissals,  for  they  knew 
that  teaching  positions  were  available  elsewhere.   But  the 
scarcity  of  gobs  during  the  mid-1970s,  the  declining  enroll- 
ments, rising  costs,  emphasis  upon  affirmative  action,  and 
tenure  quotas  have  almost  halted  job  mobility.   It  is  these 
conditions  that  have  created  a  dilemna  for  educational  gov- 
erning boards,  for  both  the  internal  and  external  forces 
must  be  reckoned  with. 

Commenting  on  the  souradness  of  public  demand  for 
accountability,  Magarrell  quoted  Joanne  Arnold  as  having 
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said,    "'The   guy  that's  paying  for  it  wants   to  knovr  what 

he's  getting— and  I  think  that's  good. '"^^  Arnold  also 

said:  ,  ,.        ■ 

'f 

'In  this  age  of  consumerism  and  maybe  a  renewed 
zeal  on  the  part  of  legislators  and  funders,  at 
least  the  state-fimded  institutions  are  going 
to  have  to  produce  information  showing  what 
various  programs  cost,  how  resources  are  being   '  •  . 
used — not  only  money,  but  people  .  .  .  .'12 

Teaching  Effectiveness  '  ^ 

For  years  educators  have  exhibited  interest  in  teaching 
effectiveness.   In  19^,  for  example,  faculty  members  at  the 
University  of  Washington  were  asked  to  complete  a  question- 
naire on  which  one  of  the  items  was  "Do  you  believe  that 
administrative  officers  have  adequate  information  concerning 
teaching  efficiency?"  Fourteen  percent  of  the  faculty 
responded  in  the  affirmative,  31%  expressed  doubt,  and  55% 
made  their  doubt  emphatic.   In  the  same  questionnaire,  the 
faculty  was  asked  to  list  items  that  should  govern  promo- 
tion.  The  item  mentioned  most  frequently  was  "teaching 
effectiveness."  Yet  when  asked  how  teaching  effectiveness 
could  be  measured,  18%  of  the  faculty  indicated  that  mea- 
surement would  be  difficult  or  impossible."''^' 
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Research  on  teaching  effectiveness  dates  hack  to  the 

1920s.   McKeachic  reported  that  the  earliest  research  dealt 

14 
with  class  size.    This  research  was  centered  upon  the 

question  of  whether  small  classes  provided  for  more  effec- 
tive teaching  than  large  classes.   Among  the  first  inves- 
tigators were  Edmonson  and  Mulder,  v/ho  compared  the  per- 
formance of  students  matched  for  intelligence  in  a  class 
of  109  with  that  of  a  class  of  43  students.^  Edmonson  and 
Mulder's  research  led  to  other  investigations  on  class  size. 
Subsequent  research  on  teaching  effectiveness  examined  other 
variables  believed  to  be  relevant  to  the  teaching-learning 
process,  for  example,  teaching  experience,  professorial 
rank,  sex,  age,  and  course  grade. 

But  despite  the  emphasis  placed  upon  research  on 
teaching  effectiveness  and  despite  their  concern  about 
teaching  effectiveness,  educators  have  done  little  to  pro- 
mote effective  teaching.   Commenting  upon  this  discrepancy 
between  theory  and  practice,  Wilson  stated: 

Everywhere,  of  course,  there  is  lip  service  to  the 
importance  of  good  teaching;  yet  in  few  places  is 
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there  systematic  and  rigorous  attention  to  reinfor- 
cing, rather  than  obstructing,  the  values  institu- 
tions claim  to  hold  in  this  regard. 1& 

Describing,  in  a  similar  manner,  faculty  attitudes  tov/ard 
teaching,  Eble  said: 

Faculty  members  respect  teaching  and  are  somewhat 
interested  in  it,  but  comparatively  few  incline 
toward  developing  teaching  as  an  art  or  Q.eveloDir^l 
themselves  primarily  as  teachers  ....   The  most° 
accurate  term  I  can  find  for  the  common  faculty 
attitude  is  respect.   It  is  not  enthusiasm  ... 
not  hostility.!/  

Wilson,  in  addition,  indicated  that  both  teachers  and  admini- 
strators were  responsible  for  the  low  value  placed  upon 
teaching: 

Both  faculty  and  administration  must  accept  CtheD 
blame  for  the  fact  that  consult ant ships,  outside 
research  grants  and  contracts,  and  publications 
score  more  points  in  the  ratings  of  academicians 
than  does  dedicated  and  effective  teaching. 18 

Teaching  Effectiveness 
and  Accountability 

Universities  and  four-year  colleges  throughout  the 
nation  have  customarily  stressed  the  publish-or-Derish 
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syndrome  in  their  hiring  practices  and  tenure  and  salary 

considerations,  often  relegating  teaching  to  a  position  that 

was  secondary  to  research  and  publications.   The  results  of 

a  1966  survey  of  all  higher  education  institutions  in  the 

United  States  showed  not  only  that  teaching  effectiveness 

was  considered  secondary  in  importance,  but  also  that 

research  and  publications  were  being  used  as  determinants 

of  teaching  ability.   Astin  and  Lee  reported: 

It  is  clear  from  the  data  .  .  .  that  the  profes- 
sor's scholarly  research  and  publication — not 
information  based  on  classroom  visits,  system- 
atic student  ratings,  student  performance  on 
examinations,  and  similar  sources — are  cur- 
rently the  primary  considerations  in  evalu- 
ating his  teaching  ability. 19 

Indeed,  for  many  years  university  and  college  adminis- 
trators were  free  to  place  emphasis  upon  research  and  pub- 
lications; the  general  public  took  no  steps  to  interfere 
with  their  establishing  of  priorities.   But  in  1975  Whit- 
field and  Brammer  wrote,  "The  time  is  at  hand  when  our 
higher  institutions  must  demonstrate  that  quality  instruc- 
tion is  their  business  or  anticipate  that  their  clients  will 

20 
go  elsewhere."    Whitfield  and  Brammer  pointed  out  that 
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although  colleges  and  univ-ersities  had  been  jolted  by  a 

variety  of  criticism  in  recent  decades,  the  students  and 
the  public — v/hose  support  was  essential — had  not  yet  deliv- 
ered the  blow  to  which  institutions  of  higher  education  were 

?1 
most  vulnerable.    They  explained: 

The  academic  Achilles '  Heel  is  a  low  level  of 
teaching  performance  which  the  institutions 
have  not  seriously  tried  to  improve.   Neither 
hiding  this  neglect  behind  a  historically  nur- 
tured professional  mystique  nor  continued  hope 
in  the  patience  of  the  clientele  will  any  lon- 
ger serve  as  adequate  defense. 22 

In  addition,  as  recently  as  197^,  Scully  reported  that  the 

Group  for  H^iman  Development  in  Higher  Education  was  calling 

for  "campus  teaching  institutes  that  w^ould  coordinate  a  wide 

variety  of  activities  designed  to  give  teaching  an  equal 

place  v/ith  research  and  publication  iri.  higher  education.  "^^ 

Lay  citizens,  however,  have  now  demonstrated  concern 

in  regard  to  faculty  members'  teaching  performance.  Wien 

they  ask,  "\fliat  are  we  getting  for  our  money?"  they  are  not 

inquiring  about  the  amount  of  research  teachers  have  done  or 

the  number  of  books  teachers  have  v/ritten;  they  are  asking, 

instead,  how  successful  faculty  members  are  in  their  teaching. 
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And  in  this  thrust  for  accountability  the  public  is  partic- 
ularly aiming  its  criticism  at  tenure  systems  and  tenured 
teachers,  expressing  the  belief  that  tenure  lavrs  shelter 
incompetent  teachers,  who  receive  unmerited  tax  dollars. 

Teaching  Effectiveness  and  Tenure 

Although  it  is  generally  believed  that  there  is  a  sig- 
nificant causal  relationship  betv/een  teaching  effectiveness 
and  tenure,  some  educators  have  pointed  out  that  such  a 
relationship  is  more  of  an  assiMiptioo  than  a  reality.   IVhit- 
field  and  Brammer  stated: 

Despite  arguments  that  promotion  and  tenure  depend 
^  upon  good  teaching,  conditions  generally  permit 
the  professor  to  improve  or  neglect  his  teaching 
as  he  chooses.   One  inevitable  consequence  is  the 
temptation  for  professors  to  attain  a  minimal  level 
of  teaching  competence  needed  for  tenure  and  chano-e 
little  thereafter. 24 

Further,  in  matters  concerning  tenure,  pay,  and  promotion 
some  faculty  members  regard  the  teaching  function  and  the 
research  functions  as  equals.   Costin  et  al.  reported,  "Some 
faculty  members  claim  that  since  good  teaching  and  good 
research  go  hand  in  hand,  it  is  sufficient  to  reward  the 
good  researcher."  -^ 
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Teaching  Effectiveness  as  Deiined 
by  the  Public  in  the  iiid-19?0s 


But  the  public  is  not  interested  in  the  traditional 
methods  of  evaluating  teaching  eff ectiven.ess;  on  the  con- 
trary, lay  citizens  in  the  2iid-1970s  are  defining  teaching 
effectiveness  as  student  achievement.   As  Lang  has  pointed 
out,  vihereas  employees  are  usually  evaluated  by  their  quan- 
titative and  qualitative  output,  in  schools  the  critical 
output  is  not  the  teacher' s  performance  but  student  achieve- 
ment.  An.d  "the  public,"  he  said,  "is  interested  in  student 
achievement,"  despite  a  x-zidespread  belief  that  measures  to 

determine  the  relationship  betv/een  teacher  behp^vior  and  stu- 

26 
dent  achievement  have  not  been  adequately  established. 

Eble  stated,  hovrever,  that  although  college  teachers 

may  claim  that  the  relationship  between  teacher  behavior 

and  student  achievement  has  not  been  fully  established, 

ample  research  has  indicated  what  constitutes  effective 

teaching: 

Wliat  most  college  teachers  are  not  aware  of  is  the 
great  number  of  careful  scholarly  investigations 
•  which  have  tried  to  find  out  v^hat  does  constitute 
effective  and  ineffective  teaching  ....   Were 
the  results  of  these  investigations  at  wide  vari- 
ance with  one  another,  the  skeptic  might  find  sup- 
port for  his  distrust  of  knowing  anything  about 
the  subject  ....   Vjliether  one  is  looking  for  the 
general  qualities  of  "uhe  effective  teacher  or  for 
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more  specific  characteristics  of  effective 
teaching,  research  studies  provide  reasonably 
consistent  answers. ■=^7 

Public  impatience  may,  then,  be  attributable  in  part 
to  faculty  members'  continuous  search  for  more  indices  of 
teaching  effectiveness.   The  impatience  may  also  be  an  out- 
growth of  the  general  uncertainty  of  the  times — uncertainty 
about  government,  the  economy,  and  foreign  relations.   On 
the  other  hand,  the  current  public  demand  for  evidence  of 
teaching  may  be  the  result  of  a  combination  of  other  fac- 
tors: increased  taxation,  spiraling  educational  costs, 
inflation,  and  unemployment.   But  whatever  the  reasons  may 
be,  it  is  clear,  according  to  Lang,  that  "there  is  a  general 
lack  of  confidence  in  the  teaching  profession."    And 
although  the  public  is  pressing  its  demand  for  accountabil- 
ity— 13  states  having  enacted  accountability  legislation 
which  mandates  evaluation  procedures  for  educational  per- 
sonnel— Lang  also  asserted  that  "the  public  is  no  longer 
willing  to  rely  on  professional  educators  to  evaluate  them- 

PQ 

selves."  -^ 
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student  Evaluation  as  a  Measure       t 

of  Teaching  Effectiveness  ,■  -"• 

An  alternative  or  supplement  to  evaluations  by  admini- 
strators and  colleagu.es  is  student  evaluation.   Although 
there  are  negative  factors  to  be  considered  in  the  use  of 
student  evaluation,  salient  arguments  have  been  presented 
in  support  of  student  evaluation  as  a  measure  of  teaching 
effectiveness.   Howe  stated,  for  example: 

Students  do  pay  for  the  instruction  they  receive; 
they  are  not  simply  a  necessary  evil  to  be  tol- 
erated as  part  of  the  educational  endeavor,  but 
are  the  purpose  of  it.   The  opinions  of  those  who 
eat  the  pudding  certainly  ought  to  be  considered 
if  we  wish  to  knov;  how  the  pudding  tastes. 50 

In  a  similar  manner,  Johnson  quoted  a  Yale  student  as 

having  said: 

'It  is  often  the  student  who  knov/s  best  when  he  can- 
not understand  or  already  knovfs  what  is  being 
discussed. 

It  is  the  student  xdio  knows  when  a  course  is  stimu- 
lating him  to  learn  more  about  a  subject  or  whether 
it  is  boring  him  to  death- 
It  is  the  student  who  can  best  formulate  those  fun- 
damental and  personal  questions  so  bothering  him 
that  he  cannot  readily  proceed  to  other  academic 
matters. 

It  is  the  student  who  can  best  evaluate  v/hen  he 
is  beginning  to  integrate  the  process  of  learning 
with  the  problems  he  continually  confronts  in 
life.' 51 
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If  educators  really  want  to  evaluate  teaching  effectiveness, 
if  they  really  v;ant  to  find  the  ansvrars;  "they  must,"  Johnson 
contended,  "be  willing  to  involve  students  and  encourage 
honest  answers."^ 

Student  Evaluations 
One  of  the  most  sensitive  areas  in  higher  education  is 
that  of  evaluation  of  instruction.   In  most  colleges  and 
universities,  teaching  has  been  and  still  is  being  judged 
on  the  basis  of  research  and  publication,  hearsay,  subjec- 
tive peer  ratings,  self-evaluations,  student  opinions,  sys- 
tematic student  ratings,  or  a  combination  of  tv/o  or  more  of 
these  bases.   The  increased  emphasis  on  accountability,  the 
pressures  of  tenure  systems,  the  surplus  of  college  teachers, 
limited  economic  resources,  and  a  rapidly  cheaiging  society; 
however;  have  collectively  created  a  demand  for  more  wide- 
spread use  of  systematic  student  evaluations  in  measuring 
teaching  effectiveness. 

•  According  to  Gustad,  Gage  identified  three  significant 
reasons  for  evaluating  teaching  effectiveness:  (a)  "to  pro- 
vide a  basis  on  which  a  nujuber  of  administrative  decisions 
can  be  made,"  (b)  "to  provide  a  basis  for  self-improvement 
by  the  faculty,"  and  (c)  "to  provide  a  criterion  that  can 
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be  employed  in  research  on  teaching  and  learning. "^^  It 
was  McKeachie,  however,  who  expressed  the  idea  that  stu- 
dents— the  "consumers"  of  courses — might  provide  the  best 
judgment  of  the  criteria  for  evaluating  instruction.^^ 
Viewing  the  emphasis  upon  student  evaluation  of  faculty  as 
an  outgrowth  of  the  student  unrest  of  the  1960s,  Fole 
pointed  out  that  "evaluation  is  one  of  the  few  formal  vrays 
students  have  of  indicating  to  the  faculty  what  they  want."^^ 

Use  of  Student  Evaluations 

Regardless  of  its  novel  appearance,  the  concept  of 

student  evaluation  of  faculty  members  is  not  new.   As  Kent 

indicated: 

The  spate  of  'report  cards'  from  students  to 
teachers  during  the  mid-1960 ' s  was  attended 
by  a  considerable  amount  of  fanfare  in  the 
newspapers:  'i\  NEW  STUDENT  REVOLT'  ;  "EALLOUT 
FROM  BERKELEY'  ;  'THE  BOOKWORM  TURLIS'  :  'SHAPE 
UP,  PROF!'  36 
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Yet,  Kent  said  that  the  idea  of  student  evaluation  of 


teaching  was  not  first  introduced  during  the  196 
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.    In  spite  of  the  bemusement  of  the  headline 
writers,  the  notion  of  having  students  rate 
the  effectiveness  of  their  instructors  is 
not  .  .  .  new.   The  University  of  Washington     '  ■ 
has  conducted  campuswide  evaluations  since 
1925.   The  University  of  Texas  and  Purdue 
were  experimenting  with  such  evaluations, 
though  on  a  more  limited  scale,  at  about  the 
same  period. 37 

In  addition,  Kent  stated  that  as  early  as  1924  Harvard  had 

initiated  the  publishing  of  a  course  and  teacher  evaluation 

booklet:   A  Confidential  Guide  to  Courses. ^^  \'\/hat  Kent  said 

was  new,  however,  were  the  manner  in  which  and  the  purpose 

for  which  the  ratings  v/ere  being  used  in  the  sixties: 

What  is  so  'revolutionary'  and  nev/sv/orthy  about 
the  student  rating  programs  being  initiated  or 
proposed  today  is  that  the  results  are  no  longer 
the  private  affairs  of  the  instructor  .... 
-  Now  the  teacher's  classroom  behavior  is  being 
subjected  to  the  scrutiny  of  faculty  committees 
on  promotion  and  tenure ,  and  student  ratings  are 
being  used  for  'administrative  purposes. '39 

Expressing  her  views  in  a  prediction  concerning  the 

use  of  student  evaluations,  Samalonis  concluded: 

Student  ratings  v/ill  be  an  additional  factor  in 
the  evaluation  of  college  teachers,  and  ... 
these  ratings  will  help  to  rev/ard  the  dedicated 


^'^Kent,  "Student  Evaluation,"  p.  515. 
^^Ibid.,  p.  328. 
^^Ibid. ,  p.  314. 
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college  teacher  for  his  outstanding  contribution 
to  the  students  and  to  the  collec^e.'^O 


Although  Kent  stated  clearly  that  there  was  nothing  new 
about  the  use  of  student  evaluation  in  measuring  teaching 
effectiveness,  she  also  indicated  that  student  evaluation 
of  teaching  effectiveness  was  not  a  widespread  practice  in 
institutions  of  higher  education  in  the  United  States.   In 
fact,  she  reported  that  in  1966  student  ratings  were  being 
used  to  a  lesser  extent  than  they  had  been  used  in  1961.^^ 
In  her  1966  study  Kent  found  that  47.6%  of  1,110  respon- 
ding higher  education  institutions  did  not  use  student 
ratings  at  all.   And  among  the  institutions  that  did  use 
student  ratings  of  teaching  effectiveness,  university 
agriculture  and  business  colleges  used  them  most  exten- 
sively, and  junior  colleges  ranked  next  in  frequency  of 

42 
use. 

But  in  the  results  of  a  more  recent  study,  Bauer 
stated,  "Student  evaluations  are  widely  used  to  assess 
teaching  effectiveness. "^^  However,  he  further  indicated 
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that  the  analysis  of  his  data  showed  that  there  was  "great 
variance'  of  opinion  regarding  use,  selection,  evaluation, 
and  application  of  the  student  evaluation."'^ 

Faculty  Views  Regarding 
Student  Evaluations 

Generally,  faculty  members  view  the  evaluation  of 
teaching  effectiveness  as  essential  in  making  decisions 
concerning  promotion,  raises,  and  tenure.   Teachers'  favor- 
able attitudes  toward  evaluation  of  teaching  effectiveness 
were  indicated  in  the  results  of  a  survey  conducted  by 
Blai:   virtually  all  of  the  1,105  faculty  members—a  sam- 
ple from  seven  colleges  and  ^universities — stated  that 
teaching  effectiveness  should  be  a  ma^or  factor  in  pay  and 
promotion  matters.  ^  But  faculty  attitudes  appear  to  be 
positive  only  in  regard  to  evaluation  of  teaching  as  per- 
formed by  their  adjiiinistrative  superiors.   Their  views  about 
student  evaluation  in  gob  advancement  and  tenure  decisions 
are,  on  the  whole,  negative.   Commenting  on  faculty  members' 
objection  to  student  evaluations,  Bauer  stated,  "A  major 
objection  revolves  around  the  qualification  of  students  to 
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judge  tlie  effectiveness  of  a  given  professor  in  terms  of  the 
iiniversity's  overall  obnectives.  "^^' 

Another  reason  for  faculty  objection  to  the  use  of  stu- 
dent evaluations  concerns  the  construction  of  the  evaluation 
instrinaent.   The  opponents  of  student  evaluation  have  said 
that  students  lack  the  qualifications  to  construct  the 
instrument.   Regarding  this  claim,  Costin  et  al.  said,  "Some 
faculty  members  will  frequently  challenge  the  admdjiistration 
and  potential  use  of  student  ratings  of  instruction  no  mat- 
ter who  prepares  the  forms.  "^'^  Further,  Costin  et  al.  stated 
that  the  opponents  of  student  evaluations  claim  that 
(a)  "ratings  v/ill  favor  an  entertainer  over  the  instructor 
who  gets  his  material  across  effectively,"  (b)  "ratings  are 
highly  correlated  with  expecced  grades,"  and  (c)  "students 
are  not  competent  judges  of  instruction  since  long-term 

benefits  of  a  course  may  not  be  clea-r  at  the  time  it  is 

4-8 
rated."    But,  Costin  et  al.  pointed  out,  the  proponents 

of  student  ratings  have  contended  that  the  validity  of  the 

objections  above  is  testable.   In  addition,  faculty  members 
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who  favor  student  evaluations  have  stressed  the  value  of 
these  ratings  to  both  the  individual  teacher  and  the  entire 
college.  -^ 

Students'  Concepts  of  the 
Effective  Teacher 

Students,  the  "consimers"  of  education,  have  always 
expressed  their  opinions  aoout  effective  and  ineffective 
teachers;  these  opinions,  hov/ever,  have  often  been  exchanged 
among  friends  in  inforraal  settings  and  casual  conversations. 
And  in  this  manner  a  valuable  so-'orce  of  feedback  to  teachers 
and  administrators  has  not  been  fully  utilized.   Feverthe- 
less,  some  formal  procedures  have  been  used  to  determine 
those  characteristics  that  students  have  considered  typical 
of  the  effective  teacher. 

Crawford  and  Bradshav;  asked  students  to  describe  the 
most  effective  college  teacher  they  had  ever  kno\m  and  to 
write  a  theme  describing  the  characteristics  most  essen- 
tial to  his  being  an  effective  teacher.   Of  the  13  descrip- 
tive statements  sorted  out,  the  four  most  frequently  men- 
tioned characteristics  x^^ere  (a)  thorough  knowledge  of 
subject,  (b)  vj-ell-planned  and  well-organized  lectures, 
(c)  lively,  enthusiastic  interest  in  teaching,  and  (d)  friendly 
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and  willing  to  help  students. ^^ 

In  a  similar  study  Musella  rjid  Rusch  obtained  responses 
consistent  with  those  of  Crawford  and  Bradshaw.   Seniors 
at  the  State  University  of  Albany  vfere  asked  to  describe 
the  teacher  behaviors  that  had  been  most  influential  in 
promoting  their  thinking.   The  characteristics  mentioned 
most  frequently  by  the  39^  respondents  were  (a)  enthu- 
siastic attitude  toward  the  sub.ject,  (b)  sympathetic  atti- 
tude toward  students,  (c;  effective  use  of  questions, 
(d)  skill  in  presenting  material,  ex.d  (e)  knovriedge  of 
subject.-' 

A  frequently  heard  arg^aiaent  is  that  students— because 

of  their  youth,  inexperience,  and  short-term  perspectives 

are  incapable  of  establishing  adequate  criteria  for  evalu- 
ating teacher  effectiveness.   Druclier  and  Remmers  fourxd 
evidence  that  seemingly  refuted  this  charge.   Using  Purdue 
al-omni  who  had  been  out  of  college  for  10  years  and  under- 
graduates who  were  currently  enrolled  at  Purdue,  they 
found  substantially  positive  relationships  between  the 
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ratings  of  teachers  by  both  groups.   Cori'elation  coefficients 

52 
for  10  traits  ranged  from  .'^0  to  .68. 

Reliability  of  Student  Evaluations 

Student  evaluations,  said  Wood  et  al. ,  have  been  criti- 
cized on  the  groiinds  that  they  represent  only  the  student's 
perspective  on  teacher  performance.   Yet,  they  stated,  "the 

empirical  studies  of  student  ratings  suggest  that  they  have 

55 
a  high  degree  of  reliability.""^"^  In  one  of  the  eai'lier 

studies  on  reliability,  Guthrie  found  that  students'  Judg- 
ments of  their  teachers  were  quite  stable  from  year  to  year. 
Comparing  students'  19'4-9  rankings  of  faculty  members  with 
their  1950  rankings,  Guthrie  foijnd  a  correlation  of  .87. 

V/hen  he  compared  students'  1951  rankings  of  teachers  with 

54- 
those  of  19^t-9,  he  found  a  correlation  of  .89-    A  signifi- 
cant factor  about  the  two  sets  of  comparisons  above  is  that 
in  making  the  second  set  of  comparisons,  194-9  siid   1951 7 
Guthrie  eliminated  a  major  threat  to  the  external  validity 
of  his  study:   selection  and  treatment  interaction.   The 
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teachers  who  were  rated  in  1950  requested  student  evaluation; 
in  1951  faculty  members  were  not  given  the  opportunity  to 
decide  whether  they  would  be  evaluated;  all  were  included. 

Using  a  forced-choice  rating  to  obtain  students'  evalu- 
ations of  their  teachers,  Lovell  and  Haner  found  that  the 
correlation  between  ratings  made  two  weeks  apart  via.s    .89. 
Split-half  reliability  was  r  =  .88  (corrected) .^^  In  a  more 
recent  study,  Costin  found  rs  ranging  from  .70  to  .8? 
between  midsemester  and  end-of-semester  ratings  of  teaching 
assistants  for  four  dimensions  measured:   skill,  structure, 
feedback,  and  rapport.   The  r  for  the  fifth  dimension— group 
interaction — v;as  .4-8.-^ 

In  regard  to  the  internal  consistency  of  student 
ratings,  Maslow  and  Zimmerman  reported  rs  from  .77   to  .94- 
when  the  ratings  of  students  in  a  given  class  were  ran- 
domly paired. ^'^   Comparing  the  mean  odd-item  ratings  on 
their  forced-choice  instrujuent  with  the  mean  even-item 
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4^^ 
ratings,  Lovell  and  Haner  foujid  that  the  r  v/as  .79.   Cor- 
rected by  the  Spearman-Brov/n  prophecy  formula,  the  r 
increased  to  .88. ^^  The  results  of  the  studies  discussed 
above  do  support  a  high  degree  of  reliability  for  student 
evaluations. 

Validity  of  Student  Evaluations 

Research  on  the  validity  of  student  evaluations  does 
not  indicate  such  positive  or  concrete  results  as  that  on 
reliability.   McKeachie  proposed  his  idea  of  having  stu- 
dents, the  "consumers"  of  courses,  provide  the  criteria  for 
evaluating  teacher  performance  in  vievi  of  his  realization 
that  "the  validity  of  student  ratings  has  been  the  chief 
bone  of  contention  betv/een  those  for  and  those  against  the 
use  of  student  ratings. "^9  McKeachie  hypotnesized  that  the 
validity  of  student  ratings  could  be  determined  on  the 
basis  of  the  extent  to  which  students'  subjective  criteria 
matched  faculty  members'  teaching  goals. ^°  In  a  comparative 
study  of  student  and  teacher  evaluations.  Centra  found,  how- 
ever, only  a  modest  relationship: 

A  comparison  of  students'  ratings  of  instruction 
with  teachers '  self-reported  ratings  in  over  3OO 
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classes  at  five  colleges  disclosed  a  modest  rela- 
tionship betv/een  the  two  sets  of  evaluations.   In 
addition  to  the  general  lack  of  agreement  betv.'-een 
self-  and  student  evaluations,  there  was  also  a 
tendency  for  teachers  as  a  group  to  give  them- 
selves better  ratings  than  their  students  did. 61 

In  an  earlier  study — one  whose  results,  they  said,  were 
less  convincijig  than  they  had  hoped  for— McKeachie,  Lin,  and 
Mann,  attempted  to  determine  some  of  the  bases  on  which 
students  made  their  judgments.   They  did  find  that  teachers 
whose  students  rated  them  high  on  "rapport"  ("warmth")  were 
effective  on  measures  of  students'  "critical  thii^Jcing.  "^^ 
McKeachie  and  Solomon  had  presented  some  evidence  that 
students  of  highly  rated  instructors  elect  more  courses 
in  the  same  field.   But  the  data  analysis  had  not  indicated 
that  there  was  a  very  consistent  relationship  between  stu- 
dent evaluations  and  student  interest  through  the  election 
of  advanced  courses.  --^ 

Another  method  used  in  attempts  to  validate  student 
ratings  is  the  comparison  of  these  ratings  xvith  colleagues ' 
ratings  of  teachers.   In  1949  and  195^  Guthrie  found  positive 
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rs  of  .48  and  .63  respectively  beWeen  students'  and  col- 
leagues' ratings  of  the  sa-f-ie  teachers.^  Maslow  and  Zim- 
merman found  a  .69  correlation  in  their  comparison  of  stu- 
dents' and  colleagues'  ratings-,  tliey  also  found  that  stu- 
dents tended  to  equate  good  teaching  with  "good  personality,'^ 
whereas  colleagues  equated  good  teaching  with  "creativity. "^^ 
Although  the  studies  on  students'  and  colleagues'  ratings 
have  shown  positive  correlations,  Costin  et  al.  pointed  out 
that  the  associations  have  not  been  significant  enough  to 
support  the  contention  that  student  ratings,  used  alone, 
have  a  contribution  to  maie  to  the  evaluation  of  teaching. ^^ 
Other  investigations  of  the  validity  of  student  ratings 
have  compared  student  evaluations  with  teachers'  years  of 
experience.   In  an  early  study  Heilman  and  Armentrout 
reported  that  there  v;as  no  significant  relationship  between 
teachers'  experience  and  student  ratings. ^"^  Guthrie  also 
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reported  a  negligible  correlation  of  .13  between  student 

ratings  and  faculty  members'  years  of  teaching  e>:peri-  ■ 

68 
ence.     Downie,  on  the  other  hand,  found  that  full  pro- 
fessors received  higher  ratings  than  those  in  other  ranks— 
especially  on  such  characteristics  as  effectiveness  of 
presentation  and  sense  of  humor. ^^  ^^  ^^^^   reported  that 
full  professors  and  associate  professors  received  signif- 
icantly higher  ratings  than  assistant  professors  and 
instructors.   In  addition,  he— just  as  Remmers  and  Elliott- 
found  that  teachers  of  lower-level  courses  consistently 
received  less  favorable  average  ratings  than  teachers  of 
advanced  courses. '^°  However,  Guthrie  had  reported  earlier 
that  underclassmen  and  graduate  students  tended  to  agree 
strongly  in  their  evaluations  of  teaching  effectiveness. 
He  found  a  correlation  of  .73.'^"^' 
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^8 
A  question  which  has  often  been  posed  concerns  the 
relationship  of  student  grades  to  student  evaluations.   The 
typical  a  priori  belief  is  that  the  higher  the  grade  the 
student  receives  or  e:^ects  to  receive,  the  better  the 
teacher's  rating  v/ill  be.   Although  some  investigators- 
including  Russell  and  Bendig  and  Stevrart  and  Malpass'^^— 
found  lov;  correlations  betv.-een  students'  grades  and  their 
eAi^aluations  of  teachers,  the  consensus  among  researchers  is 
that  there  is  no  relationship  betvreen  students'  grades  and 
their  ratings  of  teachers.   This  opilnion  is  based  on  the 
results  of  several  studies — aiaong  them  studies  conducted  by 
Guthrie  and  by  Voeks  an.d  French'^^— which  have  indicated  that 
there  is  no  correlation  betv;een  student  achievement  and  stu- 
dent evaluations. 

In  addition,  empirical  investigations,  for  exajnple, 
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those  of  Edmonson  and  Nulder;  Guthrie;  and  Rohrer,"^^  have 

led  educational  researchers  to  the  belief  that  there  is  no 

relation  between  class  size  and  student  ratings  of  teachers, 

Finally,  in  regard  to  the  role  of  sex  as  related  to 
student  ratings,  the  results  of  several  studies— Heilman 
and  Armentrout;  Doxmie;  and  Lovell  and  Haner'^^— have  indi- 
cated that  there  are  no  significant  differences  in  female 
and  male  students'  ratings  of  teachers  or  in  the  student 
ratings  received  by  male  and  female  teachers. 

As  noted  from  the  outset,  studies  on  the  validity  of 
student  evaluations  have  not  provided  concrete  ansv;ers. 
Thus,  many  of  the  questions  concerning  validity  remain 
rather  debatable.   And  it  is  these  questions  that  lead  the 
investigator  on — in  search  of  new  answers  and  in  search 
of  evidence  to  substantiate  the  findings  of  earlier 
researchers. 

Inconclusive  Evidence  Regarding 
Student  Ratings 

Although  much  literature  has  been  written  and  many 
studies  undertaken  on  student  evaluations,  much  of  the  data 
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available  and  many  of  the  results  ottained  are  inconclu- 
sive.  McKeachie  stated,  "Nuraerous  articles  have  been  pub- 
lished, arguing  for  or  against  the  use  of  student  ratings. 

76 
However,  the  research  xs  scattered."'    In  the  same  manner, 

Tolor  asserted  that  "despite  numerous  ax'ticles  dealing  with 

teaching  effectiveness  .  .  .  much  of  the  literature  is  incon- 

77 
elusive  or  offers  conflicting  results."'' 

Nevertheless,  Tolor  pointed  out  that  the  search  for 
answers  concerning  the  evaluation  of  teaching  effective- 
ness has  continued: 

The  attempt  to  assess  the  quality  of  teaching  has 
a  long  history  and  is,  of  course,  intimately  asso- 
ciated with  issues  of  value  judgments  and  measure- 
ment problems,  including  the  most  vexing  one  of 
criteria  adequacy.   Yet  the  search  for  the  'good 
teacher'  has  continued  unabated,  both  in  the  re- 
seaxch  arena  and  in  every  community  where  educa- 
tional facilities  are  staffed.'^ 

Indeed,  the  search  has  continued,  and  it  v/ill  continue;  for 

education  has  no  purpose  except  it  be  to  lead  men  on  in 

quest  of  truth.   Lee  so  aptly  stated: 

Each  of  us  comes  to  this  inquiry  Q^n  improving 
college  teaching^  v/ith  a  different  backgroiind 
and  with  different  biases  and  coKimitments.   But 
all  of  us  are  engaged  in  this  enterprise  as  a 
rigorous  intellectual  activity,  for  such  an  in- 
quiry requires  not  only  organized  reflection 
but  also  empirical  study  .  .  .  .79 


'  YlcKeachie,  Teaching  Tips,  p.  215. 
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''Tolor,  "Perceived  Teacher  Effectiveness,"  p.  98. 

"^^Ibid. 

79  •    / 

'  ^Q, .    B.  T.  Lee,  ed.  ,  Imoroving  College  Teachrn?:  (V/ash- 

ington,  D.  C:  Americaai  Council  on  Education,  19&7)5  P*  1- 


CHAPTER  IV 

PEESENTATION  OF  DATA 

V    The  7,901  student  ratings  for  268  faculty  members  in 
the  College  of  Arts  and  Sciences  at  the  University  of 
Florida  were  the  data  used  in  this  study.   Class  evalua- 
tions were  limited  to  undergraduate  courses  and  to  500-level 
graduate  courses,  which  undergraduates  were  allowed  to  enroll 
in  after  obtaining  special  permission. 

Statistical  Analysis 

The  unit  of  analysis  in  this  investigation  was  the  item 
mean  for  each  teacher.   Among  the  268  subjects  used  in  the 
study,  60  had  been  evaluated  by  more  than  one  class.   For 
these  60  faculty  members,  the  weighted  mean  was  used,  com- 
bining the  groups. 

Initially  eight  groups — defined  by  both  their  tenure 
status  and  professorial  rank — were  allov/ed  for.   The  eight 
groups  in  which  faculty  members  could  have  appeared  were: 
Group  1,  tenured  professors;  Group  2,  tenured  associate  pro- 
fessors; Group  3,  tenured  assistant  professors;  Group  ^4-, 
nontenured  associate  professors;  Group  5,  nontenured  pro- 
fessors; Group  6,  nontenured  assistant  professors;  Group  7, 
tenured  instructors;  and  Group  8,  nontenured  instructors. 
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The   groups   and  the  njjiber   of  persons   in  each  group   are 
shov/n  in  Table   1. 

Table   1 
Faculty  Members  Classified  by  Group 


T 


NT 


1 

2 

3 

4 

Group  1 
K  ^  59 

Group  2 

IT  -  65 

Group  5 
N  =  14 

Group  7 

N  =  0 

Group  5 
N  =  0 

Group  ^J- 

N  =  9 

Group  6 
N  =  116 

Group  8 

T  =  Tenured 
NT  =  Nont enured 


1  = 

2  = 

2  _ 

>  - 

4  = 


Professor 

Associate  Professor 
Assistant  Professor 
Instructor 


Although  allowance  was  made  for  eight  groups,  only  six  cells 
had  entries.   There  were  no  nontenured  professors  and  no 
tenured  instructors.   The  size  groups  xfhich  had  entries  were 
subjected  to  statistical  analysis. 

Multivariate  Analysis  of  Variance 

A  multivariate  one-way  analysis  of  variance  was  used 
to  test  for  differences  anong  the  six  groups.   A  one-way 
design  was  used  because  tenure  status  and  rsuik  vrere  treated 
as  one  variable,  since  an  examination  of  the  data  had  shovrn 
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that  status  and  rank  v/ore  interrelated.   The  use  oi"  a  mul- 
tivariate analysis  of  vari>ance  (imNOYA)  ,  instead  of  an  ■ 
analysis  of  variance  (ANOVA) ,  provided  for  the  comparison 
of  groups  in  a  more  powerful  test.   Through  I^IAITOVA  the 
mean  ratings  on  all  10  evaluation  items  were  compared  simul- 
taneously; this  simultaneous  comparison  considered  the  pos- 
sible interaction  of  the  10  vaj?iables  with  each  other.   And 
in  this  manner  ratings  on  the  evaluation  instr-oment  as  a 
whole  were  analyzed.   Had  the  purpose  of  the  investigation 
been  to  point  out  the  face-value  differences  among  the 
groups  on  single  evaluation  items,  an  analysis  of  variance 
would  have  been  sufficient.   But  ssij   conclusions  based  on  ■ 
such  an  analysis  could  not  have  been  very  meaningful  because 
no  rating  item  v/ould  have  measured  purely  xvhat  it  was  sup- 
posed to  measure  and  nothing  else. 

Through  the  utilization  of  the  Statistical  Analysis 
System  (SAS)  Package  (using  procedure  regression),  the 
results  of  the  nMTOVA  showed  that  the  six  groups  were  dif- 
ferent at  the  .05  level  of  significance.   In  the  test  for 
differences  among  the  groups,  the  value  of  F  was  found  to 
be  F  (50,1157)  =  i.Zf853^,  2>  =  0.0169.   Because  this  dif- 
ference was  significant,  attention  was  directed  toward 
finding  vihere   the  differences  were. 

Although  the  mean  ratings  for  the  six  groups  on  10 
evaluation  items  (see  Table  2)  showed  the  differences  in 
group  ratings,  these  ratings  alone  could  not  be  regarded 
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as  true  indicators  of  those  groups  that  v/ere  significantly 
different  from  each,  other.   As  a  guide  in  determining  where 
to  look  for  differences  among  the  groups,  the  univariate 
analysis  showed  that  ratings  2,  5,  ^,  5,  asid   10  had  sig- 
nificance levels  below  .05  (see  Table  3).   On  the  other  five 
ratings — 1,  6,  7,  8,  and  9 — the  significance  levels  were 
greater  than  .05,  indicating  that  group  differences  on  these 
ratings  were  not  significant. 

To  find  out  vmere  the  significant  differences  were 
among  the  groups,  simultaneous  95  percent  confidence  inter- 
vals were  set  up  for  the  means  for  ratings  2,  3,  ^,  5,  and 
10.   These  intervals,  however,  failed  to  shoxf  xirhere  the 
differences  were. 

Discriminant  Analysis 

The  data  were  then  subjected  to  a  discriminant  analysis, 
by  which  each  individual  was  reclassified  as  a  member  of  one 
of  the  six  groups  on  the  basis  of  his  similarity  to  the 
entries  in  that  group.   An  individual's  similarity  to  a 
group's  members  was  determined  by  examining  the  distance  of 
the  individual's  point  from  the  centroid,  mean  point,  of 
each  group;  each  subject  was  placed  into  that  group  to  v/hose 
centroid  his  point  was  closest.   Table  4  shews  the  number 
of  faculty  members  who  were   placed  into  each  group  through 
the  discrirainant  analysis.   The  discriminant  analysis 
regrouped  each  of  the  268  subjects  according  to  his  ratings 
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TalDle  3  ■  . 
Results  of  Univariate  KNOYA.   for  Six  Groups 

Eating;  No. Sign.  Level 

1  0.2414 

2  0.0454* 

3  0.0086* 
^  0.0009* 

5  0.0023* 

6  0.5058 

7  0.5546 

8  0.5680 

9  0.1465 
10  0.0086* 


^Significant  at  .O3  alpha  level 


Table  k 

Regrouping  of  Faculty  According  to 
Squared  Distance  Frorr.  Centrolds 
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From 
Group 

1 

N  =  59 

1 

2 

Into  G 
3 

roup 
4 

6 

8 

2  9 

15 

15 

0 

0 

0 

2 
N  =  66 

11 

43 

11 

1 

0 

0 

3 

N  =  14 

4 

3 

7 

0 

0 

0 

4 
N  =  9 

0 

1 

0 

2 

3 

3 

6 

N  =  116 

0 

0 

0 

7 

84 

25 

8 
N  =  4 

0 

0 

0 

0 

1 

3 

58 
on  the  10  varia.bles  on  the  student  evaluation  instrument. 

Suianiar.y  Measures  in  the 
Treatment  of  Data 

As  one  of  the  summary  measures  in  the  treatment  of  the 
data,  the  ratings  for  the  three  groups  of  tenured  faculty 
members  (Groups  1,2,  and  5)  and  the  ratings  for  the  three 
groups  of  nont enured  faculty  members  (Groups  4,  6,  and  8) 
were  averaged  (see  Table  5).   Hotelliiig's  T^  test  v/as  then 
used  to  determine  the  differences  between  tenured  siid  non- 
tenured  faculty  ratings. 

In  the  test  for  differences  in  the  ratings  for  tenured 
and  nontenured  faculty,  the  two  groups'  ratings  were  found  to 
be  different  at  the  .05  level  of  significance,  F  (10,257)  = 
2.11810,  2/" 0-0233.   The  univariate  ANOVA  showed  the  evalu- 
ation items  on  v^hich  the  mean  ratings  for  the  two  groups 
were  significantly  different  (see  Table  6). 

Another  summary  measure  was  used  to  test  for  rating 
differences  in  professorial  rants.   The  means  were  calcu-   ■ 
lated  for  the  ratings  received  by  professors,  associate  pro- 
fessors, and  assistant  professors  (see  Table  7)  on  the  10 
evaluation  items.   Hotelling's  T^  test  was  used  to  ascertain 
differences  between  the  ratings  of  professors  and  associate 
professors  and  differences  betvreen  the  ratings  of  associate 
professors  and  assistant  professors.  ^  ' 

The  ratings  of  professors  and  associate  professors  v/ere 
found  to  be  different  at  the  .05  level  of  signif  icsjice , 


59 


Table  5 

Mean  Ratings  for  Tenured  and  Rontenured  Faculty 
on  10  Evaluation  Items 


T 

NT 

Eating  No. 

(Groups  1,  2, 

3)  ■ 

(Groups  4,  6, 

8) 

1 

1.73 

1.73 

2 

2.06 

1.94 

3 

2.00 

1.95 

4 

2.23 

2.07 

5 

2.49 

2.29 

6 

3.19 

3.22 

? 

3.53 

3.66 

a 

2.39 

2.50 

9 

2.03 

2.04 

10 

2.31 

2.25 

Tenured 
W  =--  139 

Nont enured 
N  -  129 
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Table  6 

Results   of  Univa.riate  MTOVA  for  Tenured 
and  Non tenured  Faculty 

Rating;  No. Si^n.    Level 

1  0.5758 

2  0.0178* 

3  0.3152 
^  0.0037* 
5  0.0017 


* 


6  0.3133 

7  0.I607 

8  0.1257 

9  '  0.9806 
10  0.1806 


*  Significant   at    .05   alplia   level 
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Table  7 


Mean  Eatings  for  Professors,  Associate  Professors 
and  Assistant  Professors  on  10  Evaluation  Items 


Rating  ITo. 

Profs. 

Asso.  Profs. 

Asst.  Profs 

1 

1.87 

1.63 

1.72 

2 

2.21 

1.95 

1.93 

3 

2.16 

1.84 

1.96 

4- 

2.43 

2.06 

2.07 

3 

2.70 

2.33 

2.28 

6 

5.10 

3.21 

3.24 

7 

3.48 

3.67 

3.65 

S 

2.45 

2.37 

2.27 

9 

2.14 

1.93 

2.03 

10 

2.55 

2.09 

2.26 

^^  =  59      N  =  75         N  =  130 
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F  (10,122)  =  2.82225,  ^^  0.0038.   The  univariate  AITOYA 
indicated  the  evaluation  items  on  which  the  tvro  groups' 

ratings  differed  significantly  (see  Table  8). 

2 
Hotelling's  T  test  ijadicated  a  difference  between  the 

ratings  of  associate  professors  and.   assistant  professors 
at  the  .05  level  of  significance,  P  (10,192)  =  2. 314-36, 
2.'77' 0.0136.   The  un.ivariate  analysis  was  used  as  a  guide 
to  the  ratings  on  which  the  means  for  the  two  groups  dif- 
fered significantly  (see  Table  9). 

The  tests  which  were  applied  to  the  data  were  sig- 
nificant factors  in  determining  whether  the  null  hypoth- 
esis should  be  accepted  or  rejected.   The  summary  measures 
were  directed  toward  specific  questions  which  this  study 
sought  to  answer:   were  there  student  evaluation  measures 
that  v^ere  closely  associated  \ilth   tenure  status,  and  did 
faculty  members  in  one  professorial  rahk  receive  better 
ratings  than  faculty  members  in  another  rank? 
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Table  8 

Results  of  Univariate  ANOVA  for  Professors 
and  Associate  Professors 


Rating;  Fo.    Sign.  Level 

1  0.0065* 

2  0.0062* 

3  0.0006* 
^                              0.0003* 

5  0.0014* 

6  0.3138 

7  0.0538* 

8  0.4826 

9  0.0136* 
10                                0.0001* 


'Significant  at  .05  alpha  level 


6^ 


Table  9 

Besults  of  Univariate  MOYk   for  Associate 
Professors  and  Assistant  Professors 


Rating;  No. '    Si^n.  Level 


1 


0.2090 


2     .  0.8288 

5  0.1251 

/^  0.8651 

5  0.5828 

5  0.6698 

7  0.8204 

8  0.2016 

9  0.1214 

10      ■  0.0571 


CHAPTER  Y 

ANALYSIS  AiTD  DISCUSSION  OP  DATA 

The  problem  of  this  study  vras  to  examine  the  null 
h^rpothesis  that  there  v/ere  no  differences  in  the  ratings 
received  by  tenured  and  nontenured  faculty  in  student  evalu- 
ations conducted  in  the  College  of  Arts  and  Sciences  at  the 
University  of  Florida.   This  study  further  sought  to  deter- 
mine if  there  were  student  evaluation  measures  that  were 
closely  associated  with  tenure  status  and  if  there  were 
differences  among  the  ratings  of  faculty  members  in  the 
ranks  of  professor,  associate  professor,  and  assistant  pro- 
fessor. 

The  268  study  participants  represented  75%  of  the  355 
College  of  Arts  and  Sciences  faculty  members.   Teaching 
effectiveness  was  measured  on  the  basis  of  the  mean  rating 
received  by  faculty  members  on  each  of  the  10  items  on  the 
student  evaluation  form. 

■^        Faculty  Members  Classified  by  Group 
On  the  basis  of  both  their  tenure  status  and  profes- 
sorial rcnk,  the  study  participants  were  classified  into 
six  groups: >  tenured  professors,  tenured  associate  pro- 
fessors, tenured  assistant  professors,  nontenured  associate 
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professors,  nontenured  assistant"  professors,  and  nonten- 
ured  instructors.   The  largest  of  these  six  groups  x-/as  that 
of  the  nontenured  assistant  professors,  with  116  entries. 
A  multivariate  one-way  analysis  of  variance,  used  to 
test  for  differences  among  the  six  groups,  showed  that  the 
ratings  for  the  groups  were  different  at  the  .05  level  of 
significance.   The  univariate  AKOVA  was  used  as  a  ^ide  to 
where  these  differences  might  be  found  among  the  groups. 
The  means  for  items  2,  3,  /]-,  5,  and  10  were  significantly 
different  at  the  .05  alpha  level. 

■  Simultaneous  confidence  intervals  were  set  up  for  the 
group  means  on  the  five  ratings  that  showed  significant 
differences.   The  confidence  intervals,  however,  did  not 
indicate  v/here  significant  differences  were  among  the  groups, 
What  the  confidence  intervals  did  indicate  -was  that  no  sig- 
nificant difference  could  be  seen  through  an  analysis  of 
one  rating  at  a  time.   This  was  further  evidence  that  there 
was  underlying  interaction  among  the  10  variables  on  the 
evaluation  instrument 

Discriminant  Analysis  on  Ten  Measures 
Data  from  the  10  items  on  the  evaluation  instrument 
were  used  to  determine  whether  a  discriminant  analysis  would 
make  a  distinction  betv/een  tenured  and  nontenured  faculty. 
In  the  discriminant  analysis,  the  group  means  for  the  six 
groups — three  of  which  were  tenured  an.d  three  of  vriiich  were 
nontenured — on  the  10  evaluation  items  were  used  to  test 
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for  group  differences  on  10  measures  (the  10  item  ratings). 
The  group  centroids,  as  determined  by  one  group's  maz-cimal 
difference  from  an.other  group  on  the  10  measures,  served 
as  one  of  the  determinants  in  the  reclassification  of  group 
members.   The  other  determinant  was  the  group  member's 
ratings.   Each  faculty  member  was  reclassified  as  a  member 
of  a  group  on  the  basis  of  the  extent  to  which  his  ratings 
on  the  10  evaluation  items  resembled  those  ratings  of  a 
group ' s  memb  er s . 

The  discriminant  analysis  made  a  very  definite  dis- 
tinction betvieen  tenured  and  nontenured  faculty.   In  the 
regrouping  process,  only  one  tenured  faculty  member  was 
classified  as  nontenured;  and  only  one  nontenured  faculty 
member  was  classified  as  tenured.   This  indicated  clesLrly 
that  the  student  ratings  for  tenured  and  nontenured  faculty 
members  were  different.   Had  there  been  no  difference  between 
the  ratings  of  tenured  and  nontenured  faculty,  one-half  of 
the  tenured  subjects  would  have  been  placed  into  nontenured 
groups;  and  one-half  of  the  nontenured  faculty  would  have 
been  placed  into  tenured  groups. 

Other  results  of  the  regrouping  process  in  the  dis- 
criminant analysis  were  seen  in  the  change  in  the  n^jmber  of 
cell  entries.   Appro"iraately  one-half,  30  out  of  55,  of  the 
tenured  professors  v:ere  placed  into  the  groups  of  tenured 
associate  professors  and  tenured  assistant  professors,  15 
entries  being  regrouped  into  each.   Thus,  tenured  professors 
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were  shoica  to  be  similar  to  tenured  associate  professors 
and  to  tenured  assistant  professors.   One-tliird  of  the  ten- 
ured associate  professors  were  reclassified  in  equal  numbers 
as  tenured  professors  and  tenured  assistant  professors.   The 
one  tenured  person  who  was  regrouped  as  a  nontenured  asso- 
ciate professor  was  a  tenured  associate  professor.   One-half 
of  the  14  tenured  assistant  professors  v;ere  reclassified, 
four  as  tenured  professors  and  three  as  tenured  associate 
professors. 

Among  the  nontenured  groups  the  most  significant  shifting 
of  group  members  was  foixnd  among  the  nontenured  associate 
professors.   Two-thirds  of  the  group's  members  were  reclas- 
sified in  equal  numbers  as  nontenured  assistant  professors 
and  nontenured  instructors.   The  single  nontenured  subject 
who  was  reclassified  as  a  tenured  associate  professor  v/as 
a  nontenured  associate  professor.   Approximately  one-fourth 
of  the  116  nontenured  assistant  professors  were  reclassi- 
fied, 25  as  nontenured  instructors  and  7  as  nontenujred  asso- 
ciate professors.   Only  one  of  the  four  nontenured  instruc- 
tors was  shifted;  he  was  placed  into  the  group  of  nontenured 
assistant  professors. 

Of  the  total  100  out  of  268  subjects  who  were  placed 
into  different  groups  through  the  discriminant  analysis, 
60  were  tenured  faculty  members  and  40  were  nontenured  fac- 
ulty members.   Thus,  the  percentage-  of  i/ncorrectly  grouped 
faculty  members  was  greater  for  tenured  faculty  menbers  tlian 
for  nontenured  faculby:   4-3%  as  compax-ed  to  3^%' 


69 


Comparison  of  Student  Ratings  for  Tenured 
and  ilontenured  Facult^^ 


Because  significant  group  differences  were  shown  through, 
the  multivariate  analysis  and  the  discriminant  analysis  for 
groups  identified  by  both  their  tenure  status  an.d  rank,  com- 
parisons were  made  to  find  out  where  significant  differences 
were  between  groups  identified  by  their  tenure  status  only 
and  between  groups  identified  by  rank  only.   Comparisons 
of  interest  were  those  betv/een  (a)  tenured  and  nontenured 
faculty,  (b)  professors  and  associate  professors,  and 
(c)  associate  professors  and  assistant  professors. 

Hotelling's  ^   test  was  used  to  test  for  differences 
betv/een  the  ratings  for  tenured  an.d  nontenured  faculty. 

Hotelling's  T  test,  an  extension  of  the  t  test  to  10  dimen- 

2 
sions,  is  identical  to  the  usual  t_  ;  x-/hich  v/ould  have  oeen 

used  if  there  had  been  one  rating  item  instead  of  10  items. 
This  test  indicated  that  the  ratings  for  tenured  and  non- 
tenured faculty  members  v/ere  different  at  the  .05  level  of 
significance. 

The  univariate  AHOVA  showed  that  the  ratings  for  the 
two  groups  v;erc  significantly  different  at  the  .05  alpha 
level  on  three  of  the  evaluation  items:   2,  4,  and  5-   Table 
5  shows  that  nontenured  faculty  members  received  better 
ratings  on  all  three  of  these  items.   />J_thoush  the  remaining 
differences  v/ere  not  significant,  nontenured  faculty  received 
better  ratings  on  items  5,  €,  7,  8,  and  10  (a  high 
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rating  of  5-^+-  on  items  5  and  7  was  positive,  whereas  a 
low  rating  of  1-2  on  all  of  the  other  items  v/as  positive). 
On  items  1  and  9,  the  ratings  for  the  two  groups  viere  the 
same.   Tenured  faculty  did  not  receive  better  ratings  than 
nont enured  faculty  on  any  of  the  items. 

Comparison  of  Student  Ratings  for  Professors 
and  Associate  Professors 

2 

Hotelling's  T  test  was  also  used  to  test  for  differ- 
ences betxveen  the  student  ratir.gs  for  professors  and  asso- 
ciate professors.   The  ratings  were  different  at  the  .05 
level  of  significance.   The  umivariate  APTOVA  indicated  that 
on  all  of  the  items  except  6  and  8  the  ratings  were  sig- 
nificantly different.   Although  two  of  the  rating  differ- 
ences for  the  tvio   groups  were  not  significant,  associate 
professors  received  better  ratings  than  professors  on  all 
10  evaluation  items  (see  Table  7).   The  surface  differences 
between  the  ratings  for  these  two  groups  were  quite  distinct. 

Because  one-fourth  of  the  tenured  professors  had  been 
reclassified  as  tenured  associate  professors  in  the  dis- 
criminant analysis  of  groups  identified  by  tenure  status  an.d 
professorial  rank:,  it  had  been  assumed  that  these  two  groups 
were  quite  similar.   The  rating  differences  shov^n  in  the 
subsequent  an.alysis — by  r.ank  only — of  these  tx^^o  groups 
implied,  however,  that  the  15  members  who  had  been  shifted 
from  the  group  of  tenured  professors  to  the  tenured  asso- 
ciate professors'  group  \iere   those  professors  vmo  had  the 


best  ratings  among  the  group  of  professors.   This  seemed 
logical  v/hen  it  was  obser-v^ed  that  the  mean  ratings  for  asso- 
ciate professors  on  the  evaluation  items  were  slightly  better 
than  those  for  assistant  professors.   For  this  reason  the 
professors  with  the  best  ratings  should  have  been  grouped 
with  the  tenured  associate  professors  instead  of  the  ten- 
ured assistant  professors.   This  seemingly  logical  view  did 
not  necessarily  hold  true  v;hen  it  was  observed  that  in  the 
mean  ratings  for  six  groups  (see  Table  2)  the  ratings  for 
tenured  assistant  professors  v/ere  slightly  better  than  those 
for  tenured  associate  professors  on  items  2,  5?  6?  8?  and  9* 
The  mean  ratings  for  the  t".:o  groups  were  the  same  on  items 
1  an.d  ^.   V/liat  the  analysis  of  the  data  did  show  was  that 
in  the  discriminant  analysis  one-half  of  the  50  tenured 
professors  who  v/ere  reclassified  had  been  placed  into  the 
tenured  associate  professors'  group  and  one-half  had  been 
placed  into  the  tenured  assistant  professors'  group.   This 
equal  distributing  of  group  members  between  the  tv/o  groups 
indicated  that  the  ratings  for  tenured  associate  professors 
and  tenured  assistant  professors  were  the  same.   And  for 
this  reason,  the  group  which  professors  became  members  of 
made  no  difference. 

Thus,  the  analysis  of  faculty  members  by  ranlc  only 
pointed  out  rating  diff ere-ices  that  could  not  be  seen  when 
tenure  status  and  professorial  rai:ik  were  treated  as  one 
variable.   On  the  basis  of  r&nk  on].y,  it  v/as  clear  that  the 
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ratings  for  associate  professors  v/ere  better  than  those 

for  professors. 

Comparison  of  Student  Ratings  for  Associate 
Professors  and  Assistant  Professors 

A  comparison  of  the  student  ratings  for  associate  pro- 

2 
feasors  and  assistant  professors,  using  Hotelling's  T_  test, 

indicated  that  the  ratings  were  significantly  different  at 

the  .05  alpha  level.   But  the  un.ivariate  ANOVA  did  not  shov/ 

that  the  mean  ratings  for  the  tv/o  groups  on  any  of  the  items 

were  significantly  different.   The  only  rating  that  could 

have  been  regarded  as  significantly  different  vi&s   that  for 

item  10,  which  had  a  significance  level  of  0.0571* 

Table  7  does  show,  however,  that  the  mean  ratings  for 

associate  professors  on  items  1,  3,  9,  s^nd  10  i-ieve   slightly 

better  than  those  for  assistant  professors.   Assistant 

professors  received  slightly  better  ratings  on  items  5?  6, 

and  8.   Eatings  for  the  two  groups  were  the  same  on  items 

2,  4,  and  7- 

Summary  Statement 
■  The  analysis  of  the  data  indicated  that  there  were  sig- 
nificant differences  in  the  student  ratings  of  teaching 
effectiveness  for  (a)  tenured  and  nontenured  faculty, 
(b)  professors  and  associate  professors,  and  (c)  asso- 
ciate professors  and  assistant  professors.   The  three  sets 
of  rating  comparisons  showed  (a)  that  nontenured  faculty 
members  received  better  ratings  than  tenured  faculty, 
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(b)  that  associate  professors  received  "better  ratings  than 
professors,  and  (c)  that  associate  professors  received 
slight I7/  better  ratings  than  assistant  professors. 

In  regard  to  the  question  of  v.-hether  there  v/ere  stu- 
dent evaluation  measures  that  were  closely  associated  with 
tenure  status,  the  analysis  of  the  data  did  not  indicate  that 
there  were  definite  patterns  of  difference  by  group  on  the 
evaluation  items.   Measures  2,  4-,  and  5?  I'-owever,  did  point 
out  significant  differences  in  the  rat.ings  received  by  ten- 
ured and  nontenured  faculty  members. 
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CHAPTER  VI 

FiroiNGS,    CONCLUSIONS,    AITO  RECOMMENDATIONS 

The  focus  of  this  study  was  upon  student  evaluations 
and  the  tenure  status  of  faculty  members.   The  purpose  of 
the  study  v/as  to  examine  the  null  hypothesis  that  there  were 
no  differences  in  the  ratings  received  "by  tenured  and  non- 
tenured  faculty  in  student  evaluations  conducted  in  the  Col- 
lege of  Arts  and  Sciences  at  the  University  of  Florida. 

Findings 

The  results  of  this  investigation  did  not  substantiate 
the  null  hypothesis.  The  ratings  of  tenured  and  nontenured 
faculty  were  found  to  be  significantly  different  at  the  .05 
alpha  level.  Significant  differences  were  also  found  in  the 
ratings  received  by  faculty  members  classified  according  to 
professorial  rank:  professor,  associate  professor,  and 
assistant  professor. 

The  data  were  analyzed  through  the  use  of  multivariate 

analysis  of  variance,  analysis  of  variance,  a  discriminant 

p 
analysis,  and  Hotellmg's  T^"  test.   The  multivariate  analy- 
sis was  the  first  test  applied  to  the  data;  the  null  hj^oth- 
esis  of  this  study  v.-as  rejected  on  the  basis  of  the  results 
of  this  test  procedure.   Simultaneous  confidence  intervals 
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were  then  set  up  to  determine  which  group  means  differed 
from  their  hypothesized  values  and  were  thereby  contrib- 
uting to  the  rejection  of  the  overall  hypothesis.  These 
groups  were  not  identified  when  the  confidence  intei'vals 
were  established. 

Through  the  test  procedures  of  the  multivariate  analy- 
sis of  variance  and  the  confidence  intervals,  it  v/as  deter- 
mined that  the  rating  items  on  the  student  evaluation 
instrument  v^ere  correlated  variables.   As  such,  no  rating 
item — used  alone — would  make  a  meaningful  distinction 
between  groups  of  faculty  members. 

The  univariate  analysis  of  variance  was  used  only  as 
a  guide  to  the  item  ratings  on  which  group  means  differed 
significantly.   It  was  not  used  as  a  final  test  measure. 

.  The  results  of  the  discriminant  analysis  showed  that 
tenured  and  nont enured  faculty  members  formed  two  distinct 
groups.   The  two  groups  differed  to  the  extent  that  v/hen 
tested  to  see  if  there  was  enough  similarity  between  the 
groups'  ratings  to  cause  group  members  to  move  from  one 
tenure  category  into  the  other,  the  groups  did  not  exchange 
members.   The  discriminant  analysis  also  shov/ed  that  in 
terms  of  an  individual's  distance  from  the  centroid  of  his 
respective  group — as  defined  by  both  tenure  status  and  fac- 
ulty rank — 37'/^  of  the  faculty  members  were  incorrectly 

classified. 

2 
Hotelling's  T   test,  vjhich  v/as  used  to  test  for  dif- 
ferences betv/een  the  ratings  of  tenured  and  nontenured 
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faculty,  professors  and  associate  professors,  aiid  asso- 
ciate professors  and  assistant  professors,  indicated  that 
there  were  significant  differences  at  the  .05  alpha  level 
in  all  three  sets  of  comparisons.   A  study  of  the  group 
means  for  each  evaluation  item  and  the  univariate  analysis 
of  variance  showed  (a)  that  nontenured  faculty  members 
received  better  ratings  than  tenured  faculty  on  eight  of 
the  10  evaluation  items — with  three  of  these  rating  dif- 
ferences being  significant  at  the  .05  alpha  level;  (b)  that 
associate  professors  received  better  ratings  than  professors 
on  all  10  evaluation  items — eight  of  which  were  signifi- 
cantly different  at  the  .05  alpha  level;  and  (c)  that  asso- 
ciate professors  received  better  ratings  than  assistant  pro- 
fessors on  four  of  the  evaluation  items  and  assistant  pro- 
fessors received  better  ratings  than  associate  professors 
on  three  of  the  10  items — none  of  the  item  differences 
being  significant  at  the  .05  alpha  level. 

Because  the  multivariate  analysis  of  variance  indicated 
that  the  items  on  the  student  evaluation  instrument  were 
correlated  variables,  the  differences — though  significant 
at  the  .05  alpha  level — between  tenured  and  nontenured  fac- 
ulty, professors  and  associate  professors,  and  associate 
professors  cind  assistant  professors  are  more  accurately 
reported  in  terms  of  the  number  of  positive  ratings  vdiich 
a  group  received. 
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Conclusions 
The  findings  oi  this  study  support  the  follov:ing  con- 
clusions: 

1.  Tenure  is  negatively  related  to  faculty  me^ibers  ' 
teaching  effectiveness  as  measured  by  student  evaluations. 

2.  The  role  of  student  evaluations  is  apparently  one 
of  little  importance  to  the  tenure  status  of  faculty  mem- 
bers. 

5.  According  to  student  evaluations,  associate  profes- 
sors are  better  teachers  than  both  professors  and  assistant 
professors. 

Eecommendations 

The  results  of  this  study  alone  cannot  provide  defini- 
tive 0"i^stif ication  for  the  use  or  of  the  value  of  student 
evaluation  of  teaching  effectiveness  in  tenure  consider- 
ations.  It  is,  therefore,  necessary  for  additional  study 
to  be  given  to  the  factors  examined  in  this  investigation. 

It  is  recommended  that  attention  and  further  study  be 
given  to  the  following  relevant  concerns: 

1.  The  teaching  effectiveness  of  faculty  members  prior 
to  and  follov/ing  the  granting  of  tenure; 

2.  The  granting  of  tenure  for  a  specified  period,  •.-.'ith 
independent  evaluations  for  tenure  at  the  end  of  each  set 
time  period; 
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3-  The  v/eiglit  attached  to  teaching  effectiveness  in 
tenure  considerations; 

4-.  The  role  of  student  evaluation  of  teaching  effec- 
tiveness in  tenure  considerations. 
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